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PREFACE 


In  this  document  we  report  on  the  progress  of  the  first  year  of  a five  year 
research  program  entitled  "The  Vocabulary  of  Brain  Potentials:  Inferring  Cognitive 

Events  from  Brain  Potentials  in  Operational  Settings."  This  report  combines  the 
two  semi-annual  reports  which  concern  the  period  July  1,  1975  to  July  1,  1976. 

During  the  first  six  months  of  the  project  much  of  our  effort  was  devoted  to  the 
design  development  and  installation  of  the  laboratory  facilities  described  in 
Section  B below.  It  seemed,  therefore,  more  appropriate  to  include  a description 
of  these  physical  developments  with  the  detailed  report  of  the  scientific  work  con- 
ducted during  the  remainder  of  the  year. 

Tne  report  is  organized  as  follows.  In  Section  A we  present  a narrative  sum- 
may  of  the  proposed  experimental  program  as  well  as  a summary  of  the  laboratory's 
accomplishments  during  the  reporting  period.  In  Section  B we  present  a detailed 
description  of  the  Cognitive  Psychophysiology  Laboratory.  The  development  of  this 
unique  resource  has  been  supported  almost  entirely  with  funds  provided  under  this 
contract.  In  Section  C.l  we  discuss  the  manner  in  which  event  related  potentials 
(ERPs)  may  be  used  in  the  enhancement  of  the  performance  of  man-machine  systems, 
and  outline  our  experimental  plans.  Section  C.2  discusses  in  the  same  manner  our 
plans  for  the  incorporation  of  the  ERP  channel  in  the  Computer  Assisted  Instructional 
Environment.  These  two  sections  summarize  progress  we  made  this  year  in  identifying 
the  framework  for  the  use  of  Biocybernetic  communication  in  operational  environments 
and  in  developing  initial  test  environments  fo:  the  efficacy  of  this  channel.  Fi- 
naiiy,  Section  D incorporates  a series  of  detailed  reports  of  experimental  work  com- 
pleted during  the  reporting  period.  The  work  described  is  concerned  with  the 
elucidation  of  the  vocabulary  of  the  ERP  and  with  the  identification  of  ERPs  at  the 
single-trial  level. 
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SECTION  A 


EXPERIMENTAL  PROGRAM  AND  ACCOMPLI StIMENTS 
A.l  The  Research  Plan 

In  & proposal  wa  submitted  to  ARPA  on  April  4,  1975  we  introduced  our  research 
plans  as  follows. 


Narrative  Summary 

A. 1.1  Rationale 

We  have  demonstrated  that  cognitive  events  can  be  inferred  from  cortical  poten- 
tials which  can  be  recorded  through  the  scalp  of  intact,  awake  human  subjects.  Spe- 
cific components  of  these  event  related  potentials  (ERPs)  have  been  shown  to  be  mani- 
festations of  such  cognitive  events  as  the  preparation  to  perform  a response,  the 
preparation  to  intake  and  process  information,  the  registration  of  a surprising  event, 
or  the  processing  of  task  relevant  information.^1^  W^th  the  application  of  powerful 
analytical  techniques,  we  have  in  the  past  few  months  been  able  to  greatly  refine 
the  resolution  with  watch  we  can  dissect  the  ERP  into  cognitively  relevant  components. 
We  will  refer  to  this  phase  of  the  work  as  the  determination  of  the  ERP  vocabulary. 

A brief  nummary  of  the  available  data  on  ERP  components  which  are  demonstrably 
associated  with  cognitive  events  follows 

An  ERP  is  a transient  series  of  voltage  fluctuations  induced  in  cortical  tissue 
immediately  following  the  occurrence  of  some  critical  inducing  event.  The  ERPs  can  be 
induced  by  a variety  of  events  such  as  the  presentation  of  a stimulus,  the  occurrence 
of  a response,  a change  in  the  rate  of  stimulation,  etc.  The  amplitude  of  the  re- 
sponse, as  recorded  from  the  scalp,  is  minute  relative  to  the  on-going  brain  wave 
activity  (EEG) , and  it  is  only  through  the  use  of  signal-averaging  techniques  that 
the  waveform  and  characteristics  of  ERPs  can  be  studied. 

An  ERP  consists  of  a series  of  positive  and  negative  peaks  which  continue  for 
about  500  msec.  The  waveform,  i.e.,  the  sequence  and  timing  of  positive  and  negative 
peaks,  depends  on  the  eliciting  event,  on  the  state  of  the  subject,  and  on  the 


placement  of  the  recording  electrodes  on  the  scalp.  For  any  given  set  of  conditions 
ERPs  are  quite  consistent  between  individuals,  yet  each  individual  tends  to  display 
a characteristic  wave  pattern.  In  the  few  published  reports  of  ERPs  recorded  from  the 
same  individual  over  long  periods  the  wave  patterns  proved  remarkably  stable. 

Each  peak-to-trough,  or  base-to-peak  deflection  appearing  in  the  ERP  at  a con- 
sistent temporal  interval  following  the  eliciting  event  is  called  a "component."  Many 
components  are  "exogenous,"  that  is  they  represent  the  response  of  cortical  tissue  to 
the  arrival  of  sensory  volleys  as  a result  of  the  activation  of  a peripheral  sense 
organ.  The  exogenous  components  are  often  followed  by  what  we  shall  call  endogenous 
components.  These  represent  cortical  information  processing  invoked  by  the  psycho- 
logical demands  of  the  context  in  which  a stimulus  is  presented  rather  than  by  the 
physical  properties  of  the  stimulus.  For  example,  we,  and  others,  have  shown  that  if 
a stimulus  provides  task-relevant  information  to  a subject  the  ERP  elicited  by  that 
stimulus  will  be  characterized  by  a large  positive  going  wave  with  a latency  to  the 
peak  of  about  300  msec.  We  call  this  component  P300. 

With  few  exceptions,  ERP  components  are  labeled  by  a <character><number>  designa- 
tion. The  character  indicates  the  polarity  of  the  component  (P  = positive,  N = nega- 
tive), the  number  refers  to  the  modal  delay  between  the  eliciting  event  and  the  peak 
of  the  component. 

1.  N100 . Present  in  ERPs  elicited  by  all  stimuli  of  moderate  and  high  intensi- 
ties. Recent  evidence  suggests  that  the  amplitude  of  N100  is  a function  of 
the  degree  to  which  subject  is  attending  selectively  to  the  modality  in  which 
the  stimuli  are  presented. 

2.  N19 3 . This  ERP  component,  studied  in  detail  in  our  laboratory,  seems  to  be 
elicited  whenever  a rare,  or  unexpected,  event  occurs.  It  is  of  particular 
interest  because  it  can  be  elicited  by  stimuli  which  are  in  fact  in  the 
periphery  of  the  subject's  attention  span.  Due  to  the  fairly  recent  discovery 
of  N190  the  details  of  its  relationship  to  psychological  variables  have  yet 


to  be  worked  out. 
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3.  P300.  This  is  the  most  robust  of  the  endogenous  ERP  components.  In  more 
than  a dacade  of  research  it  has  been  recorded  in  many  laboratories,  in  a 
large  number  of  situations.  It  seems  to  be  most  reliably  recorded  in  associ- 
ation with  task-relevant,  rare  stimuli  and  seems  to  reflect  in  amplitude  the 
complexity  of  the  information  processing  invoked  by  the  stimulus. 

4.  ^Slow_Wave".  We  have  established  that  the  P300  component  is  often  followed 
by  a slow  potential  shift  which  is  affected  by  the  same  variables  which  are 
known  to  affect  the  P300  except  that  it  has  a different  scalp  distribution. 
Whereas  P300  appears  largely  as  a positive  going  potential  peaking  on  the 
parietal  (posterior)  scalp,  the  slow  wave  is  positive  going  in  parietal  elec- 
trodes and  negative  going  in  frontal  electrodes. 

5l  Jhe  Contingent  Negative  Variation  (The  CNV) . This  wave  precedes  anticipated 
events  in  response  to  which  the  subject  will  have  to  perform  a demanding 
motor,  or  mental,  act.  It  is  very  reliably  recorded  during  the  warning  inter- 
val (foreperiod)  in  a reaction  time  task,  in  the  form  of  a negative  ramp 
beginning  about  400  msec  after  the  warning  stimulus  and  peaking  just  prior 
to  the  response-commanding  (imperative)  stimulus. 

.Readiness  Potential  (RP).  This  is  a CNV-like  wave.  It  is  distinct  only  in 
the  sense  that  it  appears  prior  to  self-paced  voluntary  responses.  Its 
occurrence  is  independent  of  the  presence  of  an  eliciting,  or  a command 
stimulus.  The  relationship  between  the  RP  and  the  CNV  is  a subject  of  much 
active  research  and  some  controversy. 

The  determination  of  the  ERP  vocabulary  consists  of  defining  with  ever  increasing 
resolution  the  specific  psychological  variables  which  determine  the  amplitude  and  scalp 
distribution  of  these  potentials.  It  is  also  necessary  to  develop  techniques  for 
dissecting  any  given  waveform  into  its  constituent  components.  These  have  been  the 
triin  charges  of  our  past  research  and  we  feel  we  made  substantial  progress.  Speci- 
fically, we  have  developed  a powerful  combination  of  Principal  Component  analysis  and 
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analysis  of  variance  which  has  enabled  us  to  clarify  the  relationship  between  ERP 
(4) 

components. 

As  the  known  vocabulary  of  ERPs  develops  it  becomes  increasingly  likely  that  the 
ERP  might  play  an  important  role  in  man-computer  interactions.  If  the  vocabulary  can 
be  "understood11  by  a computer,  and  there  is  no  doubt  that  it  can,  then  an  important 
communication  link  can  be  established  between  the  operator  and  his  equipment.  At 
least  three  advantages  are  apparent  in  such  a communication  channel. 

1.  As  the  ERPs  seem  to,  at  least  in  part,  manifest  events  in  the  nonverbalized 
substrate  of  cognition  they  may  provide  information  which  cannot  be  otherwise 
communicated  by  the  operator. 

2.  The  immediate  access  ERP  components  provide  into  the  subject's  cognitive 
world  suggest  that  they  might  enhance  communication  speed. 

3.  The  strong  presumptive  evidence  that  an  individual's  ERP  is  unique  suggests 
that  these  potentials  might  constitute  an  ongoing  self  authenticating  com- 
ponent of  the  communication  process. 

The  project  plan  proposed  here  capitalizes  on  the  success  of  the  first  two  years 
of  our  ARPA  support  and  is  designed  to  develop  realistic  implementations  of  biocyber- 
netic  communication  systems  in  simulated  operational  environments. 

We  see  the  following  specific  tasks. 

a.  Refine  our  present  knowledge  of  the  ERP  vocabulary.  Particular  emphasis 
will  be  placed  on  the  newly  discovered  Ni90  and  "slow  wave"  components,  as 
well  as  on  consolidating  our  understanding  of  P300  as  a measure  of  the  feed- 
back subjects  derive  from  specific  stimuli. 

b.  Test  the  utility  of  the  well  established  vocabulary  in  enhancing  performance 
of  operator**  controlling  complex  devices  (with  our  major  model  being  the 
aircraft  cockpit) . 

c.  Test  the  utility  of  the  vocabulary  in  the  Computer  Assisted  Instruction  envir- 
onment. Here  the  model  will  be  the  PLATO  lesson  and  our  goal  the  facilitation 
of  interaction  between  the  student  and  the  teaching  console. 


The  major  difficulty  in  developing  the  ERP  as  a communication  channel  is  the 
very  low  signal  to  noise  ratio  in  the  channel/5'*  The  ERPs  are  minute  in  amplitude 
relative  to  the  "polyneurai  roar"  of  the  ongoing  EEG  activity.  In  determining  the 
vocabulary,  signal  to  noise  ratios  can  be  enhanced  through  the  use  of  signal-averaging. 
This  technique  relies,  of  course,  on  the  repeated  occurrence  of  the  cognitive  events 
as  well  as  on  the  computer's  precise  knowledge  of  their  time  of  occurrence.  While 
this  procedure  is  adequate  for  vocabulary  identification  it  will  not  do  for  practical 
communication  in  operational  environments.  In  these  we  must  be  able  to  identify  the 
occurrence  of  ERP  components  in  the  ongoing  EEG  activity  immediately  following  single 
occurrences  of  the  specific  events.  The  problem  then  becomes  one  of  developing  single- 
trial signal  extraction  techniques  (STSE) . 

We  have  been  developing  STSE  procedures  for  some  time/^  Work  conducted  with 
our  present  ARPA  support  indicates  that  Stepwise  Discriminant  Analysis  (SWDA)  proce- 
dures allow  correct  classification  of  trials  at  a hit  rate  of  80  percent.  This  hit 
rate  is  based  on  a crude  application  of  SWDA.  It  is  likely  that  STSE  could  be  greatly 
improved  by  combining  data  from  multiple  channels  and  by  prefiltering  the  ongoing  EEG 
activity  to  eliminate  energy  in  the  "noise"  bandwidth  before  discrimination  begins. 
Development  work  on  STSE  could  not  begin  in  earnest  prior  to  the  identification  of  the 
vocabulary  and  it  is  contingent  on  computational  power  which  will  be  at  our  disposal 
according  to  present  project  plans.  We  intend  to  devote  much  effort  to  the  single- 
trial problem.  The  development  of  a STSE  is  contingent  also  on  the  development  of 
refined  techniques  to  increase  signal  to  noise  ratio  in  the  real-time  evaluation  of 
performance.  In  fact,  failure  to  "correctly"  detect  ERPs  on  single  trials  may  often 
be  due  to  variability  in  the  concomitant  performance  variables  as  much  as  it  is  due 
to  inherent  "noise"  in  the  EEG.  Thus  the  development  of  STSE  techniques  requires  a 
conjoint  measurement  of  performance  and  EEG  variables.  We  need  techniques  which  lead 
towards  sufficiently  accurate  definitions  and  measures  of  single  "performance"  events, 
which  can  then  be  correlated  with  their  ERP  crunterparts . The  investigation  of  this 
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problem  and  the  development  of  such  techniques  will  be  directed  by  the  Aviation 
Research  Laboratory.  Both  research  programs  will  be  joined  in  an  effort  to  improve 
the  real-time  evaluation  of  cognitive  and  behavioral  events.  All  data  collected  in 
all  experiments  to  be  conducted  in  the  laboratory  would  provide  a data  base  for  the 
development  of  STSE  procedures.  The  operational  environments  in  turn  will  be  used 
for  specific  demonstrations  of  these  procedures  as  they  emerge. 

A. 1.2  Research  Plan 

Three  concurrent  activity  streams  will  he  maintained  during  the  next  year. 

a.  The  procurement  and  installation  of  hardware  and  software  for  recording  ERPs 
in  simulated  cockpits  and  in  a CAI  installation. 

b.  Intensive  development  of  STSE  techniques  and  the  implementation  of  at  least 
one  demonstration  in  which  a STSE  is  used  in  biocybernetic  communication. 

c.  Continuation  of  work  on  vocabulary  identification,  using  our  existing 
facility. 

It  should  be  emphasized  that  even  though  a major  development  effort  will  be  re- 
quired by  activity  stream  a,  we  plan  to  maintain  a steady  level  of  effort  in  the  other 
two  categories.  If  the  proposed  personnel  contingent  is  approved  the  installation  of 
the  new  laboratory  can  be  accomplished  with  no  reduction  in  our  present  rate  of  progress 

Moreover,  we  intend  to  support  the  use  of  our  facilities  by  remote  investigators  as  the 
need  arises. 
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A. 2 Summary  of  Accomplishments 

The  following  summarizes  the  results  of  the  research  conducted  during  the  report- 
ing period  in  this  laboratory  with  the  support  of  Contract  if  US  Navy  N00014-76-C-0002  en- 
titled "The  Vocabulary  of  Brain  Potentials:  Inferring  Cognitive  Events  from  Brain 

Potentials  in  Operational  Settings."  Most  generally  stated  we  have: 

1.  Greatly  expanded  our  knowledge  of  the  P300  component  of  the 
numan  event  related  brain  potential  (ERP) , to  the  extent  that 
we  now  have  a fairly  good  understanding  of  the  variables 
which  control  P300  amplitude  and  latency.  Thus,  strong  infer- 
ences can  now  be  drawn  from  this  ERP  component  about  an  oper- 
ator s cognitive  activity.  More  limited  conclusions  were 
developed  with  respect  to  other  elements  of  the  ERP  vocabulary. 

2.  Demonstrated  conclusively  that  P300  can  be  detected  without 
recourse  to  signal  averaging  using  stepwise  discriminant 
analysis. 

3.  Developed  the  paradigms  in  which  the  utility  of  a biocybernetic 
communication  channel  could  be  evaluated  within  a pursuit  track- 
ing environment  and  within  the  CAI  environment.  -nitial  experi- 
mentation in  both  environments  has  been  concluded. 

These  general  statements  are  based  on  the  following  results: 

A . 2 . 1 ERP  Vocabulary  Elaboration 

In  reviewing  the  following  results  the  reader  should  keep  in  mind  that  a.ll  per- 
tain to  the  ERP  elicited  by  task-relevant  stimuli.  The  same  sequence  of  physical 
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stimuli  presented  to  the  same  subjects  while  they  perform  tasks  to  which  the 
stimuli  are  not  relevant  fail  to  elicit  a P300.  It  is  this  sensitivity  of  P300  to 
degrees  of  task  relevance  which  implies  its  potential  utility  in  the  Bioc/bernetic 
applications  we  plan  for  FY  77  and  the  following  years. 

a.  We  have  discovered  chat  the  amplitude  o.  P300  is  exquisitively  sensitive 
to  momentary  variations  in  a psychological  variable  we  choose  to  call  "expectancy." 

We  have  demonstrated  that  the  "expectancy"  of  an  event  varies  as  a function  of  three 
variables,  the  number  of  like  events  occurring  in  the  recent  past,  the  specific 
structure  of  the  preceding  series  of  events  and  the  a priori  probability  of  the  event. 
Using  a mathematical  model  based  on  these  assumptions  about  expectancy  we  can  explain 
80%  of  the  variability  of  PJ00.  Specifically,  the  more  "unexpected"  an  event,  the 
larger  the  amplitude  of  P300  it  elicits  (Squires,  Wickens,  Squires  & Donchin,  Science, 
in  press;  see  also  Section  D.l). 

b.  We  have  shown  that  the  relation  between  P300  and  expectancy  is  independent 
of  the  modality  of  the  stimulus  used  to  elicit  the  P330  at  least  when  we  use  visual 
and  auditory  stimuli  (Squires,  Petuchowski,  Wickens  & Donchin,  in  preparation  ). 

c.  We  completed  a parametric  study  of  the  relationship  of  P300  to  the  a priori 

probability  of  an  event.  The  data  confirm  the  results  described  in  (a)  above  and 
establish  that  the  relation  of  P300  to  expectancy  holds  over  the  entire  range  of  a 
priori  probabilities  from  0.10  to  0.90.  Furthermore,  the  data  support  the  assumption 
made  in  our  model  that  the  effects  of  a prior  lity  and  of  sequential  constraints 

interact  in  an  additive  manner  to  determine  the  upiitude  of  P300  (Duncan-Johnson  & 
Donchin,  in  preparation). 

d.  We  investigated  ERPs  elicited  by  compound  stimuli,  that  is  by  simultaneously 
presented  auditory  and  visual  stimuli.  This  study  enabled  an  analysis  of  the  behavior 
of  P300  when  stimuli  deliver  redundant  and  non-redundant  information.  The  data 

* 
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suggest  that  it  is  possible  to  infer  from  the  amplitude  and  latency  of  P300  to 
which  element  of  a stimulus  compound  a subject  is  directing  attention  (Squires,  N. , 
Squires,  K.,  Donchin  & Grossberg,  submitted  for  publication;  Section  D.2). 

e.  As  P300  seems  to  be  enhanced  by  stimuli  which  resolve  the  subject's  uncer- 
tainty, it  was  important  to  determine  if  resolving  temporal  uncertainty  (i.e.,  deter- 
mining when  an  event  will  occur)  is  as  effective  as  resolving  event  uncertainty 
(determining  which  event  will  occur).  We  completed  a study  which  demonstrated  that 

P300  is  not  affected  by  temporal  uncertainty  (McCarthy  & Donchin,  in  press;  Section 
D . 3)  . 

f.  We  have  begun  to  investigate  the  role  of  the  feedback  value  of  stimuli  in 
determining  P30C  amplitude.  When  a stimulus  which  serves  to  indicate  to  the  subject 
whether  or  not  he  has  performed  some  task  correctly  elicits  a P300,  it  turns  out  that 
the  amplitude  of  P300  varies  with  the  difference  between  the  intensity  of  the  stimulus 
which  indicates  to  the  subject  that  he  performed  the  task  correctly  and  that  which 
indicates  errors.  The  bigger  the  intensity  difference  between  the  "correct"  and 
"error"  indicators  the  larger  the  P300  elicited  by  these  stimuli.  These  data  suggest 
that  the  utility  of  a stimulus  in  a feedback  loop  affects  the  amplitude  of  P300. 

g.  We  have  shown  that  P300  latency  is  determined  by  the  duration  of  the  cogni- 
tive activity  required  of  the  subject  before  he  can  correctly  categorize  the  eliciting 
event.  This  result  is  very  important.  It  establishes  that  the  "late  positive 
components"  whose  latency  may  range  from  300  msec  to  over  600  msec  after  the  physical 
eliciting  stimulus  are  all  instances  of  the  P300  component.  This  experiment  was  also 
important  in  demonstrating  that  different  physical  stimuli  which  belong  to  the  same 
semantic  category  can  elicit  the  same  P300,  if  the  subject  performs  the  same  cognitive 
operation  on  the  stimuli  (Kutas  & Donchin,  in  press;  Section  D.4). 

h.  An  important  aspect  of  the  data  obtained  in  all  the  experiments  described 
above  is  that  in  all  cases  P300  shows  the  same  scalp  distribution,  with  a maximum  over 
the  parietal  lobe  ("association  cortex").  Analysis  of  the  scalp  distribution  of  ERP 
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components  is  emerging  as  a major  tool  in  the  interpretation  of  the  data. 

1.  We  conducted  a detailed  analysis  of  the  degree  to  which  slow  negative  pre- 
paratory potentials  will  show  a differential  distribution  over  the  two  hemispheres 
as  a function  of  the  nature  of  the  processing  required  of  the  subject  (verbal  vs. 
spatial  tasks).  We  do  find  such  lateralization  of  the  preparatory  potentials.  How- 
ever, it  occurs  only  when  the  processing  demands  vary  from  trial  to  trial.  No  changes 
are  observed  when  the  processing  demands  are  uniform  over  the  trial.  Our  data  sug- 
gest that  the  lateralization  of  the  potentials  changes  in  the  amplitude  of  the  poten- 
tials recorded  over  the  left  hemisphere  rather  than  reciprocal  changes  in  the  acti- 
vities of  both  hemispheres  (Donchin,  Kutas  & McCarthy,  ii  press;  see  D.5). 

j.  In  a detailed  analysis  of  all  ERP  components  elicited  during  a categoriza- 
tion task  we  have  been  able  to  dissociate  clearly  two  additional  endogenous  components 
of  the  ERP,  the  N200  and  the  Slow  Wave.  These  data  confirmed  and  clarified  reports 
from  other  laboratories.  The  N200  component  promises  to  allow  monitoring  of  fluctua- 
tions in  the  focus  of  attention  (Squires,  Donchin,  McCarthy  & Herning,  in  press;  see 
D.  6)  . 


A* 2. 2 Single  Trial  Analysis  Techniques 

a.  Sixteen  subjects  were  presented  with  a series  of  tones,  each  tone  either 
1000  Hz  or  1500  Hz.  The  a priori  probability  of  the  1500  Hz  tone  was  0.10.  These 
rare  tones,  elicit,  of  course,  a P300.  When  these  data  are  used  to  develop  for  each 
subject,  a discriminant  function  we  find  that  we  can  classify  correctly  over  80%  of 

the  individual  stimuli  obtained  from  each  subject  (Squires,  Donchin,  in  press;  see 
D.  7)  . 

b.  The  generality  of  the  discriminant  function  was  evaluated  by  developing  a 
cross-subject  function  using  the  data  from  all  subjects  and  testing  this  function  both 
on  the  data  of  each  of  the  16  subjects  and  on  data  obtained  from  seven  new  subjects. 

In  all  cases  the  classification  performed  quite  well,  percentages  of  correct  classifi- 
cations ranging  from  64  to  77%  (see  D.7). 
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c.  While  an  80  correct  classification  rate  is  remarkable  we  pursued  the  possi- 
bility that  the  misclassif ications"  reflect  real  changes  in  the  subject's  response 
to  the  external  stimulus.  The  search  led  to  the  discovery  of  the  dependence  of  P300 
on  the  sequence  of  preceding  stimuli  (A. 2. la).  We  then  conducted  a study  in  which  the 
a priori  probabilities  of  the  two  stimuli  were  equal.  The  discriminant  functions  are 
now  developed  on  the  basis  of  the  two  extreme  expectancy  conditions  (that  is,  we  dis- 
criminate between  all  stimuli  preceded  by  four  identical  stimuli  and  all  stimuli  pre- 
ceded by  four  different  stimuli) . This  classification  in  terms  of  expectancy  appears 
to  identify  correctly  the  expectancy  associated  with  each  stimulus  in  the  sequence. 
This  study  demonstrates  that  single  trial  identification  of  the  subject's  cognitive 
response  to  the  stimulus  is  feasible. 

d.  We  have  shown  that  discriminant  functions  developed  on  the  basis  of  auditory 
sequences  can  be  successfully  applied  to  visual  stimuli  and  vice  versa. 

A. 2. 3 Operational  Environments 

a.  Two  studies  were  completed,  each  using  six  subjects,  in  which  ERPs  were  re- 

it 

corded  while  the  subjects  performed  a pursuit  tracking  te^k.  The  difficulty  level  of 
the  tracking  was  systematically  manipulated.  The  experiments  helped  to  identify  tne 
problems  encountered  during  such  tests.  Most  of  the  problems  have  by  now  been  solved 
and  systematic  experimentation  has  begun.  The  data  obtained  in  the  first  two  experi- 
ments are  inconclusive  and  indicate  several  sources  of  uncontrolled  variation  in 
subject  motivation  and  performance  which  have  been  corrected.  The  data,  however,  do 
indicate  that  ERP  waveform  changes  with  subject's  task  load.  However,  the  patterns 
varied  from  subject  to  subject.  In  an  attempt  to  force  a more  uniform  strategy  on  the 
subjects  the  experiment  has  been  redesigned  using  compensatory  rather  than  pursuit 
tracking  tasks. 

b.  Several  experiments  were  conducted  in  which  ERPs  were  obtained  from  the 
subject  interacting  with  a Plato  terminal.  Again  the  problems  associated  with  record- 
ing in  this  complex  environment  have  been  identified  and  many  were  solved.  These 
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studies  have  led  to  the  selection  of  the  Drill  end  Practice  paradigm  no  the  proto- 
typical CAI  task  for  testing  the  efficacy  of  the  blocybernetic  channel.  (Drill  and 

Practice  is  the  set  of  procedures  whereby  a student  is  helped  in  memorizing  lists  of 
Items . ) 

In  summary  then,  we  have  been  successful  in  our  pursuit  of  the  vocabulary  of 
ERPs  and  in  developing  the  techniques  for  real  time  use  of  the  endogenous  components 
of  the  ERP.  In  addition,  at  the  end  of  this  first  year  of  the  project  we  completed 
on  schedule  the  development  of  the  facilities  for  studying  ERPs  in  semi-operational 
environments  and  are  already  deep  into  the  experimental  phase  of  this  aspect  of  the 
program. 


A. 3 Analysis  of  Milestones 

We  list  here  the  project's  milestones  as  outlined  in  the  original  proposal  for 
the  reporting  period  and  review  the  extent  to  which  we  attained  each. 

Milestones 


July  1,  1975 


September  1,  1975 


- lBaue_fprmal  purchase  orders  for  all  required  equipment. 
Done . 

~ Install  Plato  terminal  and  begin  ERP  recordings. 

Done. 

Begin  recording  ERP  in  Aviation  Research  Lab's  GAT-2 
Simulator . 

The  feasibility  of  such  recordings  has  been  es- 
tablished. However,  due  to  the  cost  involved  in  the  use 
of  the  GAT-2  and  other  ARL  facilities  it  was  decided  to 
restrict  all  experimental  activity  to  the  premises  of  the 
Cognitive  Psychopnysiological  Laboratory  during  the  first 
two  years  of  the  project. 
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December  1,  1975 


April  1,  1976 


' goPPlete  study  of  Cross-modal  P3QQ  as  well  as  CNV-RP 
studies.  Submit  for  publication. 

Done . 

Jl^g-V-ide  on-line  demonstration  of  the  feasibility  of 
single  trial  techniques  in  the  detection  study. 

Done.  We  used  the  "odd-ball"  paradigm  instead  of  the 
detection  paradigm. 

Complete  installation  of  all  lrhoratory  equipment  system. 
Begin  software  installation . 

Done . 

- Complete  installation  of  11/70  system. 

Done,  except  that  instead  of  the  11/70  we  acquired 
and  installed  the  Harris  Slash  4 (to  be  replaced  by  a 
Slash  7 in  August  76) . 

- Complete  first  ERP/ tracking  study. 

Done . 

“ A1L...4  computers  in  the  network  fully  implemented  and 
interconnected . 

Partially  done.  All  computers  are  functioning.  The 
computers  are  also  interconnected  using  300  baud  lines. 
The  DECNET  software,  however,  was  delivered  by  DEC  in 
May,  1976  (8  months  behind  schedule)  thus  the  full 
implementation  of  an  online  network  has  been  delayed 
and  is  now  scheduled  for  September,  1976. 

- Connection  to  ARPANET  complete. 

It  was  decided  not  to  connect  the  laboratory  to  the 
ARPANET.  The  Harris'  computational  power  made  us  fairly 
independent  of  off-site  computers. 
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- Specification  of  CAI-ERf  studieb  completed. 

Done . 

" At  least  4 ERP  vocabulary  studies  submitted  for  publi- 
cation . 

Done . 

July  1,  1976  - PDP  11/70  and  rest  of  network  used  in  at  least  one  on- 

line experiment. 

Awaits  installation  of  DECNET . However,  all  links  in 
the  chain  on  each  of  the  networks  components  is  now 
fully  functional. 

- Standard  procedures  available  for  all  ARPANET  data 
storage  and  data  analysis. 

Implemented  on  the  Harris. 

“ STSE  procedures  standardized  for  rest  of  project. 
Partially  done. 

- ARL  recording  techniques  fully  developed.  At  least 
one  ERP  experiment  completed  at  AP_ . 

Postponed.  Budget  does  not  permit  and  project  needs 
do  not  justify  use  of  simulator.  These  activities  are 
now  scheduled  for  FY  78.  Note  that  ARL  personnel  are 
actively  involved  in  project  and  in  experiments  at  CPL. 
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SECTION  B 

THE  FACILITIES  OF  THE  COGNITIVE  PSYCHOPHYSIOLOGY  LABORATORY 
B.l  Introduction 

The  Cognitive  Psychophysiology  Laboratory  (CPL)  is  dedicated  to  the  study  of 
electrocortical,  and  other  psychophysiological , manifestations  of  cognitive  processes. 
The  Laboratory's  primary  interest  is  in  elucidating  the  functional  significance  and 
physiological  basis  of  such  endogenous  components  of  Event  Related  Brain  Potentials  as 
P300  and  the  CNV.  This  interest  is  expressed  within  the  framework  of  an  attempt  to 
develop  Biocybernetic  man-machine  communication  channels  which  by  enriching  the  infor- 
mation available  to  a computer-driven  system  about  its  operators,  may  enhance  the 
performance  of  the  system. 

The  Laboratory's  main  source  of  support  is  the  Cybernetic  Technology  Office  of 
the  Advanced  Research  Projects  Agency  of  the  Department  of  Defense.  The  CPL's  con- 
tract with  ARPA  is  one  of  several  contracts  which  ARPA's  Biocybernetics  Program, 
managed  by  Dr.  Craig  Fields,  has  awarded  to  investigators  in  universities  and  other 
research  organizations.  In  addition  to  its  own  research  program,  the  CPL  serves  to 
test  the  applicability  of  findings  developed  by  other  investigators  in  the  simulated- 
operational  environments  it  has  developed. 

The  CPL  is  directed  by  Professor  E.  Donchin  and  its  scientific  staff  consists 
cl  collaborating  faculty  members,  post-doctoral  Research  Associates  and  graduate 
students.  These  are  aided  by  a technical  support  staff  of  engineers,  programmers, 
technicians  and  secretaries.  The  Laboratory  is  fully  integrated  in  the  Department  of 
Psychology  of  the  University  of  Illinois.  Appointments  at  the  Laboratory  at  all 
levels  are  made  through  the  Department  and  all  personnel  must  meet  the  Department's 
acceptability  criteria. 


' ....  ...  . 
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B .2  Description  of  Facilities 

B. 2 . 1 General 

The  Cognitive  Psychophysiology  Laboratory  occupies  over  3500  square  feet  in  the 
Department  of  Psychology's  building.  The  building,  opened  in  1969,  haa  been  well 
designed  to  meet  the  needs  of  research  in  Psychology.  There  are  extensive  shop  facili- 
ties, a good  animal  colony,  computer  facilities  with  easy  access  for  data  paths  from 
all  parts  of  the  building  and  good  control  over  illumination  and  other  environmental 
conditions.  The  laboratory  wing  is  exceptionally  free  of  electrical  and  elec  .rostatic 
noise,  easing  the  burden  of  the  psychophysiologist. 

The  Department  of  Psychology  has  been  generous  to  CPL  in  allocating  both  labora- 
tory and  office  space.  Cramped  out  adequate  office-space  is  available  for  the  entire 
staff  and  for  data-storage  and  data-analysis . The  laboratory  space  houses  the  CPL's 
Harris  Slash  7 computer,  three  computer-based  laboratories  and  such  auxiliary  services 
as  a shop  and  a computer  t-nmii,  il  room. 

B . 2 . 2 The  Network:  Overview 

The  functional  organization  of  the  laboratories  is  shown  in  Figure  1.  A Star 
network  of  computers  supports  the  laboratories.  At  the  center  of  the  star  is  a PDP 
11/40  computer  whose  prime  function  is  to  manage  the  operations  of  the  Network.  This 

computer  is  referred  to  as  tM  Front  End  (FE)  and  is  driven  by  the  RSX11D/DECNET 

package  supplied  by  Digital  Equipment  Corporation.  Through  the  services  of  DECNET 
it  interconnects  the  three  laboratory  computers  with  each  other,  and  all  three  with 

the  Harris  Slash  7.  [Note:  While  all  components  of  the  Network  are  operational  when 

this  is  written  (7/1/76),  the  DECNET  software  has  been  installed  but  the  Harris  - DEC 
interface  is  yet  :o  be  completed.  Implementation  is  underway  and  the  Network  is 
expected  to  be  operational  by  Sept.  30,  1976.] 

One  of  the  four  outer  points  of  the  star  is  the  Harris  computer.  This  is  a "Midi" 
computer,  fully  described  be3ow,  which  can  support  most  of  the  data  reduction  and 
data  processing  needs  of  the  Laboratory.  This  it  can  do  both  for  previously  acquired 
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data  or  online  through  the  Network. 

At  the  other  three  nodes  are  three  computers,  each  supporting  a Psychophysiolo- 
gical  laboratory.  These  use  a PDP11/40  (GT44)  supporting  a Human  Performance  Lab,  a 
PDP  11/10  (GT40)  which  is  attached  to  PLATO,  the  University  of  Illinois'  Computer 
Assisted  Instruction  System,  and  a PDP  8/e  which  supports  both  a standard  experimental 
psychology  lab,  and  a facility  for  studying  the  relation  between  cortical  activity 
and  motor  behavior  in  humans . 


B.2.3  The  Laboratories 

B . 2 . 3 . 1 General  Features 

All  three  labs  share  the  following  features : 

(a)  All  experimental  control  and  data  acqusition  are  under  computer 
control. 

(b)  The  laboratory  computer  can  support  a moderate  degree  of  on-line 
data  analysis  and  extensive  information  on  the  progress  of  the 
experiment  can  be  provided  on-line  to  the  investigator. 

(c)  Experimental  control,  data-acquisition  and  on-line  feedback  are 
all  controlled  by  Fortran-callable  assembler  subroutines.  Thus 
while  the  computer's  speed  and  power  can  be  applied  to  its  tasks 
the  investigator  - _ed  program  in  FORTRAN  only. 

(d)  Data  acquisition  is  all-digital.  Both  raw  data  and  processed  data 
are  stored  on  9-track,  industry  compatible,  magnetic  tapes  during  the 
experimental  sessions.  (Analog  data  recording  is  still  required  in 
the  8/e  supported  laboratory.  This  lab  will  be  converted  to  all- 
digital  operation  in  1977.) 

(e)  Each  laboratory  has  the  following  components: 

(1)  Stimulus  generation  and  response-logging  equipment. 

(2)  Psychophysiology  recording  system  (mostly  for  FEG) . 

(3)  A computer. 
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(4)  Experimenter  display  and  control  station. 

The  following  sections  will  briefly  describe  each  of  the  three  laboratories. 

® • 2 • 3 . 2 The  Human  Performance  Laboratory 

A detailed  block  diagram  of  the  lab  is  shown  in  Figure  2.  At  the  core  of 
the  lab  is  a GT44  computer  system.  This  is  a PDP  11/40  with  a special  display  pro- 
cessor (VT17) . Notable  is  the  extensive  configuration  of  this  GT44.  It  is  equipped 
among  other  things  with  memory  management,  54K  of  core,  2 disks  and  2 tape  drives. 

A wide  range  of  stimulus  generating  equipment  driven  by  an  Iconix  system  is  available 
(e.g.,  a 4 field  Tacnistoscope , tone  generating  equipment,  etc.).  In  addition,  a 
Megatek  display  is  used  in  generating  a tracking  display.  Targets  following  fairly 
complex  paths  are  generated  on  an  oscilloscope  screen  and  the  subject  can  control 
the  screen  display  via  a joystick  according  to  the  exper xmenter 's  instructions. 

As  an  example  of  the  laboratory's  capacity  we  describe  one  of  our  current 
experiments:  Subject  is  performing  a two-dimensional  tracking  task.  The  target 

is  driven  by  the  computer  which  also  monitors  the  subject's  joystick.  The  target 
behavior  is  changed  adaptively,  on-line,  to  achieve  a prespecified  performance  level 
by  the  subject.  While  tracking  the  target  the  subject  is  presented  with  a series  of 
tones,  each  of  which  may  be  either  high  (1500  Hz)  or  low  (1000  Hz),  according  to  a 
computer  determined  random  schedule.  The  subject's  EEG  is  digitized  continuously  from 
12  electrodes.  Epochs  of  EEG  just  preceding  and  just  following  the  tones  are  stored 
on  digital  tape.  These  same  epochs  can  be  displayed  to  the  investigator.  At  the 
same  time  the  average  event  related  potential  is  computed,  stored  on  another  digital 
tape  and  may  be  displayed  to  the  investigator.  A record  of  the  subject's  performance 
both  on  the  tracking  task  and  on  a secondary  task  associated  with  the  tones  is  also 
kept  on  tape.  A summary  of  the  session  results  can  be  printed  out.  At  anytime  during 

the  session  the  investigator  can  easily  change  any  of  the  parameters  controlling  the 
experimenter. 

B.2.3.3  The  PLATO  Laborato  y 

A block  diagram  of  the  laboratory  is  shown  in  Figure  3.  The  figure  shows 
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the  final  configuration  of  this  lab  which  should  be  completed  by  September  1,  1976. 

A more  limited  configuration  is  currently  in  use. 

The  laboratory  is  based  on  a GT40  (which  is  an  11/10  with  a display  pro- 
cessor), with  16K  of  core,  a disk  and  one  digital  tape  deck.  Its  mode  of  operation 

is  much  like  that  of  the  Human  Performance  Lab  with  the  limitations  imposed  by  its 
smaller  configuration. 

The  laboratory,  however,  is  unique  in  that  it  serves  as  an  intelligent 
terminal  for  the  PLATO  system.  Its  intelligence  extends  to  the  capability  of  record- 
ing psychophysiological  responses  associated  with  any  specific  event  or  class  of 
events  in  the  PLATO  lesson.  The  access  to  PLATO  provides  a unique  opportunity  to  study 
the  psychophysiology  of  the  instructional  process.  In  addition,  PLATO's  extensive 
computing  power  coupled  with  its  rich  graphic  display  capabilities  provide  the  user 
with  unprecedented  power  to  design  complex  experiments  in  human  information  processing. 

It  should  be  noted  that  an  as  yet  unrealized  benefit  of  the  PLATO  connec- 
tion is  that  it  provides  users  of  the  PLATO  network  direct  access  to  our  network. 

As  any  PLATO  terminal  can  communicate  with  any  other  terminal,  remotely  located 
terminals  can  be  provided  with  full  access  to  the  CPL's  own  n twork  (albeit  at  speeds 
not  exceeding  300  baud) . 

In  a typical  experiment  the  subject  will  be  progressing  through  a PLATO 
drill  and  practice  lesson.  The  sequence  of  PLATO  material  is  intercepted  by  the  GT40. 
This  allows  tighter  control  of  the  timing  properties  of  the  display.  Moreover,  the 
GT40  can  initiate  PLATO-related  digitizing  of  EEG  in  relation  to  either  stimulus  or 
response  events  in  the  lesson.  The  data  are  displayed  to  the  investigator  and/or 
processed  and  stored  for  further  analysis. 

B.2.3.4  The  Motor  Performance  Laboratory 

A block  diagram  of  this  laboratory  is  shown  in  Figure  4.  The  central  com- 
puter is  a PDP  8/e  with  16K  of  core,  one  disk  and  assorted  peripherals.  This  labora- 
tory is  also  equipped  with  a Hewlett  Packard  3955  14  channel  FM  tape  recorder.  All 
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data  are  recorded  on  tape  and  digitized  off-line  on  an  IBM  1800  in  the  Psychology 
Department's  computer  facility.  We  plan  to  upgrade  the  system  during  1977  to  allow 
digital  recording  of  the  data.  This  will  be  done  either  by  adding  equipment  to  the 
PDP  8/p  or  by  replacing  the  8/e  with  another  PDP  11. 

The  lab  is  equipped  with  a 3 field  Iconix  T' scope,  and  the  usual  array  of 
tones  can  be  generated.  A unique  feature  is  a bimanual  electronic  dynamometer  with 
which  the  force  exerted  by  isometric  movements  of  the  subjects  can  be  measured  with 
considerable  precision.  The  PDP  8/e  is  equipped  with  an  interface  to  the  PLATO  ter- 
minal which  allows  the  terminal's  digital  output  to  trigger  actions  by  the  computer. 

A limited  range  of  PLATO  related  experiments  can  be  conducted  in  the  lab. 

A typical  experiment  has  the  subjects  squeeze  one  or  the  other  of  the  dynamometers 
with  the  right  or  the  left  hand.  Scalp  potentials  associated  with  the  movements  are 
digitized  online  by  the  PDP  8/e  and  the  averages  are  displayed  to  the  investigator. 

The  EEG  is  continuously  recorded  on  the  FM  tape  in  conjunction  with  event  labeling 

pulses.  The  data  are  subsequently  digitized  and  averaged  on  the  IBM  1800  and  the 
Harris  computer. 

B.2.4  The  Harris  Slash  7 

The  data  acquired  by  the  three  laboratories  is  processed  by  this  computer,  a 
block  diagram  of  which  is  shown  in  Figure  5.  This  24  bit  computer  is  equipped  with 
three  tape  drives,  two  80  MB  disk  drives  and  a 1.7  MB  fixed  head  disk.  Large  data 
bases  can  be  kept  on  the  disks  for  analysis.  The  Harris  can  execute  fairly  elaborate 
statistical  programs.  We  have,  for  example,  implemented  several  programs  of  the  BMD 
package,  including  the  Principal  Components  Program  (BMD08M)  and  the  Stepwise  Dis- 
criminant Analysis  Program  (BMD07M) . Both  are  applied  to  data  bases  consisting  of 
hundreds  of  80-150  element  vectors.  The  Harris  can  execute  programs  requiring  up  to 
25b  K words  by  utilizing  its  virtual  memory  feature.  It  can,  in  fact,  execute 
several  such  programs  in  parallel. 

Most  of  our  work  is  done  in  FORTRAN,  though  the  Harris  supports  BASIC  and  SNOBIL 
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as  well  as  RPG.  Its  VULCAN  operating  system  includes  several  important  utilities, 
such  as  a SORT/MERGE  package  and  a full  accounting  system.  VULCAN  has  combined  time- 
sharing and  Batch  capabilities,  and  the  system  can  be  accessed  via  7 time  sharing 

ports,  three  of  which  are  available  to  remotely  located  investigators  through  Dial- 
in  lines. 

In  addition  to  the  BMD  programs  we  have  already  implemented  on  the  Harris  a Time 
Series  analysis  package  and  a FORTRAN  callable  version  of  SOUPAC,  the  University  of 
Illinois  statistical  analysis  package.  A variety  of  programs  are  also  available  for 
managing  psychophysiological  data  bases.  A measure  of  the  system's  power  is  the 
fact  that  it  currently  supports  almost  the  entire  data  processing  needs  of  the  Cogni- 
tive Psychophysiology  Laboratory.  These  needs  were  previously  met  by  the  Computer 
Services  Office  at  Illinois  and  the  CCN  facility  at  UCLA.  [Please  note  that  while 
this  section  refers  to  the  Harris  Slash  7,  we  have  as  yet  a Slash  4 only.  This 
machine  is  substantially  slower  than  the  Slash  7.  The  Slash  7 will  be  delivered  in 
the  next  couple  of  months.] 

As  soon  as  the  link  via  DECNET  is  established  between  the  Harris  and  the  labora- 
tory computers  network,  data  could  be  streamed  to  the  Harris  during  an  experimental 
run.  This  will  be  done  if,  and  when,  data  processing  at  a level  exceeding  the  capa- 
city of  the  PDP  11  will  be  required  to  determine  the  course  of  an  experimental  run. 
Thus  for  example,  the  Harris  may  be  called  upon  to  develop  a discriminant  function 
to  be  used  during  an  experiment,  to  estimate  the  parameters  of  an  adaptive  filter,  or 
to  perform  the  computations  required  by  the  more  complex  displays. 

In  addition  to  its  role  as  the  prime  number  cruncher  for  CPL,  the  Harris  will 
support  a wide  range  of  ancillary  activities.  We  ordered  an  Imlac  PDS-4  graphics 
terminal  to  allow  interactive  examination  of  the  ERP  waveforms.  A Houston  plotter  is 

already  on  site.  Other  activities  may  range  from  manuscript  preparation  to  biblio- 
graphic services. 


31 


SECTION  C 

THE  USE  OF  EVENT-RELATED-POTENTIALS  IN  THE  ENHANCEMENT 
OF  MAN-MACHINE  SYSTEM  PERFORMANCE 

This  section  presents  our  current  thinking  on  the  manner  in  which  a Uiocybernetic 
communication  channel  can  be  incorporated  in  a man-machine  system  to  improve  system 
performance. 

The  enhanced  understanding  of  the  ERP  vocabulary  together  with  the  improved 
ability  to  read  the  vocabulary  on  single  Lrials  enables  an  accelerated  exploration  of 
the  applications  of  the  vocabulary  in  mar.-machine  interactions.  Two  avenues  of  appli- 
cations emerge  from  the  present  research.  One  related  to  the  evaluation  of  operator's 
workload,  task  difficulty  and  spare  capacity  by  using  probe  stimulus  techniques  and 
secondary  task  paradigms.  This  application  is  thoroughly  discussed  in  Section  C.l, 
together  with  a description  of  our  preliminary  experiment  using  a tracking  task. 

We  also  plan  to  pursue  the  enhancement  of  performance  in  multistimulus,  multi- 
event time-varying  situations,  such  as  failure  monitoring  on  multi-instrument  panels, 
Air  Traffic  control  situations,  and  C.A.I.  lessons  when  students  are  presented  with 
complex  multielement  displays.  In  all  of  these,  due  to  temporal  or  other  constraints, 
the  operator  attends  selectively  and  p' ocesses  actively  only  part  of  the  available 
information  for  all  practical  purposes  ignoring  the  rest.  Stimulus  selection  is 
governed  by  a complex  weighting  function  which  is,  for  the  great  part,  subjective  and 
impossible  to  reconstruct  from  the  final  observed  response.  An  index  of  selective 
attention  that  continuously  indicates  the  events  attended  to  can  greatly  enhance  the 
efficiency  of  man-machine  interaction.  In  failure  detection  and  in  air-traffic  con- 
trol situations  such  an  index  may  be  utilized  to  design  improved  warnings  and  informa- 
tion presentation  algorithms.  In  other  situations  it  may  be  used  in  computer  aided 
decision  making.  In  the  C.A.I.  environment  it  may  be  employed  in  the  development  of 
better  material  and  student  evaluation  procedures,  training  schedules  and  branching 
techniques. 
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The  results  reviewed  in  other  sections  of  this  report  support  the  idea  that 
ERP  can  serve  as  such  an  index  of  selective  attention.  It  was  shown  that  ERP  and 
in  particular  the  P300  component  is  associated  only  with  stimuli  that  were  percuived 
as  relevant  and  were  actively  processed.  It  was  further  shown  that  a complex  (bi- 
modal  or  otherwise)  situation  can  be  decomposed  so  that  the  stimulus  attended  to 
can  be  identified.  These  results  are  also  supported  by  earlier  experiments  from 
this  lab.  As  we  can  identify  these  components  on  a trial  to  trial  basis  there  is 
a strong  indication  they  can  be  used  in  real  environments.  Finally,  there  are  some 
indications  that  with  the  help  of  ERP  measures  we  may  be  able  to  distinguish  between 
failures  of  performance  that  originate  from  stimulus  rather  than  from  response  selec- 
tion problems.  This  is  an  important  theoretical  and  practical  distinction  in  the 
context  of  the  complex  command  and  control  environment. 

Section  C . 2 discusses  in  more  detail  the  problems  we  shall  address  in  the  CAI 
environment  and  preliminary  experimental  plan. 

— £gJjfc.h°phy3iological  Measures  in  the  Adaptive  Man-Machine  System 

The  remarkable  developments  in  mini-  and  micro-computers  is  transforming  the 
design  of  man-machine  systems.  The  computer  industry  is  producing  smaller,  faster 
and  more  economical  computers.  It  is,  therefore,  increasingly  easier  to  incorporate 
computers  as  control  components  in  man-machine  systems  with  striking  effects  on  the. 
flexibility  of  the  systems,  host  notable  is  the  increasing  prevalence  of  adaptive 
systems.  In  these  the  computer  can  affect  the  nature  of  the  man-machine  interaction 
by  implementing  dynamically,  an  opt-mizing  algorithm.  System  behavior  can  be  adjusted 
to  the  continually  changing  states  of  the  operator,  the  environment  and  to  the 
interaction  between  the  two.  This  flexibility  depends  on  an  exchange  of  information 
between  the  operator  and  the  machine.  Within  the  framework  of  a computer  based  system 
it  is  possible  to  conceive  of  novel  channels  of  communication  to  supplement  conventional 
display  and  concrol  interfaces.  This  report  describes  a program,  which  is  one  of 
several  Biocybernetic  programs  supported  by  ARPA's  Cybernetic  Technology  Office,  which 
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see?.<j  to  develop  such  a communication  channel  utilizing  information  which  can  be 
deri  ,ed  from  brain-waves. 

The  environment  for  which  we  developed  these  channels  is  exemplified  by  the 
hypothetical  high  performance  aircraft  with  on-board  computer  facilities  represented 
in  Figure  1.  The  conventional  Display,  Pilot,  Control  and  Plant  components  are 
supplemented  by  various  performance  aids  which  can  be  implemented  or  adjusted  on-line. 
These  may  consist  of  the  addition  or  removal  of  predictive  display  information,  an 
alteration  of  the  Control  or  Plant  dynamics  along  various  axes  or  perhaps  the  assump- 
tion of  control  of  certain  tasks  normally  performed  by  the  operator.  In  order  that 
these  adaptive  decisions  be  made  intelligently  by  the  on-board  aiding  center,  a 
managing  computer  or  Decision  Center  shown  in  Figure  1 must  be  well  informed.  The 
information  it  requires  includes  obviously  characteristics  of  the  mission,  the  status 
of  other  aircraft,  vehicular  disturbances  and  ground  controlled  inputs.  Additionally, 
it  would  be  extremely  useful  to  the  Decision  Center  to  have  estimates  of  two  important 
aspects  of  the  opera * or' s attentional  state:  what  information  he  is  processing  or 

ignoring  at  any  time  (selective  attention) , and  his  overall  level  of  workload  or 
involvement  with  on-going  tasks.  Operator  workload  in  this  sense  is  often  conceptualized 
as  a variable  that  is  reciprocally  related  to  the  amount  of  residual  attention  avail- 
able to  deal  with  unexpected  environmental  contingencies  (1) . 

Various  performance  measures  are  traditions? ly  used  to  index  attention  and  work- 
load. These  have  been  found  to  provide  adequate  indices  of  both  aspects  of  the  atten- 
tional state.  For  example,  in  a multi-display  selective  attention  task,  the  alloca- 
tion of  attention  between  sources  of  discrete  stimuli  has  been  revealed  by  response 
latency  (2,3)  or  accuracy  (4).  Attention  allocation  to  continuous  tasks  has  been 
successfully  identified  through  changes  in  tracking  gain  (2,4),  information  transmitted 
(^) » time  delay  (5),  holds  in  the  tracking  output  (6,7),  remnant  or  observation  noise 
(8,9),  or  by  more  complex  coefficients  of  a linear  discrete  time  series  model  (10). 

Operator  workload  or  residual  attention  has  often  been  measured  by  the  "secondary 
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task  loading"  technique  (11) . The  operator  is  presumed  to  possess  some  limited 
quantity  of  processing  resources  which  can  be  distributed  among  various  tasks.  As  a 
primary  task  is  made  more  difficult— its  workload  demand  increased— a greater  quantity 
of  the  limited  resource  is  required  to  maintain  criterion  performance,  and  conversely 
a lesser  amount  remains  to  perform  the  secondary  task.  As  a consequence,  secondary 
task  performance  decreases,  serving  as  an  index  of  primary  task  difficulty.  Such 
techniques  have  proven  reliable  in  comparing  different  display  or  control  configura- 
tions (12),  or  in  validating  subjective  estimates  of  control  task  difficulty  (13). 

While  performance  measures  do  serve  adequately  as  indices  of  selective  attention, 
their  use  is  necessarily  restricted  to  tasks  in  which  overt  responses  are  produced. 

Thus  they  are  inappropriate  for  a class  of  tasks  that  are  becoming  critically  important 
in  modern  system  control:  passive  monitoring  during  which  few  overt  responses  are 

emitted  by  the  operator.  To  assess  the  allocation  of  attention  during  a monitoring 
task,  periodic  probe  events  must  be  inserted  in  the  environment  and  an  overt  (detection) 
response  to  the  probes  required.  Such  probes  are  of  necessity  disruptive  to  ongoing 
performance.  The  difficulties  encountered  by  an  on-line  assessment  of  workload 
through  secondary  task  loading  are  more  severe.  The  secondary  task  performance  may 
well  disrupt  performance  on  the  primary  task  with  possibly  critical  consequences.  It 
may  also  saturate"  the  residual  attention  that  it  was  designed  to  assess. 

Even  in  situations  where  the  above  restrictions  are  not  encountered  (for 
example  divided  attention  between  two  information  transmission  tasks) , a further  limi- 
tation upon  the  usefulness  of  performance  measures  is  presented  by  the  inherent  response 
variability  which  precludes  reliable  estimates  of  attention-sensitive  parameters  from 
a single  observation.  Thus  assessment  of  any  or  all  of  the  performance  measures 
described  above  must  involve  a number  of  behavioral  observations  taken  over  time,  a 
requirement  which  further  limits  the  usefulness  of  these  measures  in  closing  an  on-line 
adaptive  loop  such  as  that  shown  in  Figure  1. 

The  shortcomings  of  performance  measures  point  to  an  urgent  need  for  additional 
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sources  of  information  which  can  either  supplement  or,  as  in  the  monitoring  and 
workload-measurement  situations  described  above,  replace  the  performance  measures  in 
providing  information  to  the  Decision  Center.  It  is  for  this  reason  that  we  have 
inflated  an  investigation  to  determine  if  psychophysiological  measures  can  serve  as 
indices  of  human  information  processing  characteristics.  Psychophysiological  measures 
have  two  important  properties  that  counteract  the  drawbacks  of  performance  variables 
pointed  out  above.  (These  advantages  are,  of  course,  purchased  at  the  cost  of 
increased  complexity  in  measurement.  The  cost  effectiveness  of  these  procedures  is  a 
matter  for  future  research  and  will  not  be  discussed  here.)  It  is  reasonable  to 
assume  that  the  inherent  random  noise  sources  which  perturb,  or  contribute  to  the 
variability  of  psychophysiological  measures  are  relatively  uncorrelated  with  the 
sources  or  performance  variability.  Assuming  an  independence  of  the  noise  sources, 
the  information  provided  jointly  by  both  signals  in  any  given  observation  period 
should  be  of  greater  reliability  than  the  information  provided  by  either  source  alone. 
In  other  words  the  time  required  for  a Decision  Center  to  obtain  an  estimate  of  the 
subject's  internal  state  at  a given  level  of  reliability  will  be  reduced  u'hen  esti- 
mates are  based  upon  jv  t measures. 

The  second  advantageous  feature  of  psychophysiological  measures  is  that,  with 
proper  instrumentation,  they  may  be  assessed  in  a manner  that  is  less  disruptive  to 
ongoing  performance  than  the  monitoring  "probes"  or  the  secondary  tasks  discussed 
above.  One  example  of  the  potential  usefulness  of  such  measures  has  been  provided 
by  another  Biocybernetics  project  in  which  Beatty  (14)  has  demonstrated  the  utility 
of  pupil  diameter  as  a measure  of  the  operator's  cognitive  processing  load.  Our  own 
efforts  focus  on  the  scalp  recorded  event-related-potential  (ERP)  as  a source  which 
may  provide  useful  information  concerning  the  operators  cognitive  state. 

C.2  The  Event-Related-Potential 

The  ERP  is  a transient  voltage  change  in  the  brain  which  is  elicited  by  any 
discrete  event,  and  which  may  be  recorded  by  surface  electrodes  attached  to  the  scalp. 


Superimposed  on  the  ongoing  EEG,  the  ERP  extends  for  at  least  500  msec,  and  is 
characterized  by  a series  of  distinct  positive  and  negative-going  peaks  with  charac- 
teristic latencies  following  the  stimulus  (15,16).  The  amplitude  of  the  different 
peaks  appears  to  be  sensitive  to  physical  and  informational  characteristics  of  the 
stimulus.  The  multivariate  nature  of  the  ERP  provided  by  the  separate  peaks  reinforces 
its  potential  value  in  providing  considerable  information  to  an  on-board  computer. 

Although  normally  the  ERP  to  a single  stimulus  is  masked  by  the  on-going  EEG 
voltage,  rendering  it  difficult  to  identify  from  a visual  record,  multitrial  averaging 
techniques  can  serve  to  cancel  the  noise  contribution  and  provide  an  estimated  ERP 
associated  with  an  event.  Alternatively,  and  of  critical  importance  for  on-line  assess- 
ment of  behavior,  a wide  variety  of  techniques  are  being  developed  and  implemented  as 
a part  of  this  project  which  will  enable  successful  identification  and  classification 
of  the  characteristics  of  an  ERP  on  a single  trial  (17,18).  Such  techniques  include 
frequency  domain  filtering  of  EEG  activity,  iterative  time  domain  adjustment  to 
reveal  peaks  (19)  or  application  of  linear  discriminant  analysis  (20). 

Although  the  success  of  ERPs  as  indicants  of  attention  in  a complex  cockpit-like 
environment  has  not  been  established,  there  is  nevertheless  strong  experimental  evi- 
dence that  components  of  the  waveform  are  sensitive  to  attentional  manipulations. 

Thus  for  example,  Donchin  and  Cohen  (21)  have  found  that  the  amplitude  of  the  late 
positive  peak  of  the  waveform  (P300)  reflects  the  allocation  of  attention  to  each  of 
the  elements  in  a two  element  visual  display.  This  finding  has  been  replicated  in  the 
auditory  modality  (22,23).  Earlier  components  of  the  waveform  have  also  been  found 
to  be  enhanced  by  focussed  attention  (24,25).  Clearly  then,  the  evoked  potential  does 
reflect  all-or-none  discrete  shifts  in  attention  as  defined  by  the  relevance  or  non- 
relevance of  an  information  source. 

There  is  much  less  validation  in  the  literature  of  the  ability  of  the  ERP  measures 
to  distinguish  between  levels  of  workload  or  attention  on  a continuous  or  graded  basis 
in  a manner  which  has  been  established  with  performance  variables  (e.g.,  2,5).  In  a 
study  in  which  ERPs  were  recorded  to  stimuli  in  a two-channel  signal  detection  task. 
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Lafayette,  Dinand  and  Gentil  (26)  were  able  to  observe  changes  in  the  early  positive 
and  negative  components  of  the  ERP  as  the  stimuli  were  made  more  or  less  relevant  by 
instructional  manipulations.  In  a second  study,  they  found  reliable  changes  in  the 
early  components  of  the  ERP  to  detected  tones  as  the  workload  of  a secondary  cognitive 
reasoning  task  was  manipulated. 

C.3  Preliminary  Experimentation 

We  are  currently  investigating  the  capability  of  ERP  measures  to  reflect  the 
subject  s information  processing  characteristics  in  an  environment  that  simulates  more 
closely  the  control  and  monitoring  tasks  confronted  by  the  pilot.  Our  basic  experi- 
mental approach  is  to  record  ERPs  to  probe  auditory  or  visual  stimuli.  These  probes 
are  either  irrelevant  to  the  tasks  performed  (and  may  therefore  be  ignored  by  the 
subjects),  or  require  only  a minimum  amount  of  cognitive  processing,  thus  avoiding 
any  disruption  or  primary  task  performance.  In  a selective  attention/monitoring 
paradigm,  the  probe  stimulus  may  occur  along  one  of  the  relevant  channels,  displays 
or  information  sources  to  determine  if  the  elicited  ERP  will  reflect  the  extent  to 
which  that  source  is  being  processed.  The  stimulus  attribute  of  the  probe  will  how- 
ever be  different  from  the  attributes  of  the  channel  that  is  relevant  to  the  monitor- 
ing task.  That  is,  if  the  subject  is  monitoring  a visual  channel  for  a spatially 
defined  event,  the  probe  will  involve  an  intensity-change.  Alternatively,  in  a 
divided  attention  processing  task,  the  ERP-eliciting  stimuli  can  be  the  same  stimuli 
as  those  that  are  processed  and  responded  to  in  the  performance  of  the  tasks.  Finally, 
in  a workload  manipulation  paradigm,  the  probes  are  presented  along  channels  that  are 
totally  irrelevant  to  the  primary  task  performed,  in  order  to  determine  if  the 
elicited  ERP  s will  reflect  the  residual  attention  available  from  that  task  as  its 
wo~kload  is  manipulated. 

We  have  investigated  ERP  s and  residual  attention  in  a pilot  experiment  in 
which  six  subjects  performed  a two-dimensional  pursuit  tracking  task  with  dynamics 
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on  both  axes.  Twelve  3-minute  practice  trials  were  first  presented  to  bring  the 
subjects  to  a stable  level  of  performance  via  adaptive  techniques  with  forcing 
function  cutoff  frequency  employed  as  the  adaptive  variable. 

ERP's  were  next  recorded  in  two  workload  manipulation  sessions.  The  probes 
consisted  of  a Bernoulli  series  of  rare  and  frequent  tones  differing  in  pitch.  The 
two  sessions  differed  from  each  other  according  to  whether  the  probe  stimuli  were 
ignored  or  processed.  'Processing"  involved  maintaining  an  internal  count  of  the 
number  of  rare  stimuli  that  occurred  during  a trial  (see  Figure  2) 

Within  each  session,  workload  was  manipulated  by  two  different  methods  (Figure  3). 
First,  the  forcing  function  bandwidth  was  increased  and  decreased  by  30%  from  the 
asymptotic  level,  achieved  by  each  subject  in  the  adaptive  practice  session.  This 
generated  3 different  levels  of  objective  task  difficulty.  Then,  based  upon  the  per- 
formance of  each  subject  in  the  intermediate  and  high  bandwidth  conditions  (moderate 
and  large  error  respectively),  two  target  diameters  were  selected,  equal  in  value  to 
the  RMS  error  measured  for  each  subject  in  those  two  conditions.  A third,  larger 
diameter  was  also  selected  of  proportionately  greater  size.  In  this  manner  the  manipu- 
lation of  target  diameter,  or  required  error  tolerance  was  "calibrated"  for  each 
subject  according  to  his  sensitivity  to  the  bandwidth  manipulations,  the  object  of 
this  calibration  being  to  obtain  equivalent  manipulations  of  subjective  performance 
demands  across  all  subjects.  Tracking  under  the  three  target  sizes  was  performed  at 
the  constant  intermediate  bandwidth  level.  It  was  therefore  assumed  that  progressively 
residual  attention  would  be  made  available  from  thp-  tracking  task  as  the  error 
tolerance  (and  obtained  error)  was  increased. 

The  two  particular  workload  manipulations  employed  may  be  placed  in  context  by 
assuming  that  the  attentional  demands  or  subjective  difficulty  of  a task  is  a joint 
function  of  its  objective  difficulty  (e.g.,  task  characteristics  such  as  input  band- 
width or  dynamics),  and  the  performance  level  required  (in  the  present  case,  specified 
by  the  target  diameter) . What  we  have  done  then  is  to  manipulate  each  of  these 
dimensions  of  difficulty  separately,  while  holding  the  other  constant. 
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The  logic  of  the  tracking  task,  prohe  signal  presentation  and  ERP  recording 
was  controlled  by  a PDP  11/40  computer  (27).  ERP's  recorded  from  3 electrode  sites 
were  amplified  and  were  displayed  on-line  via  a GT-44  graphics  display  terminal.  The 
data  was  also  recorded  on  digital  tape  for  later  off-line  analysis  and  plotting  by  a 
Harris  computer. 

The  preliminary  data  thus  far  collected  has  indicated  that  stable  ERP  waveforms 
can  in  fact  be  elicited  by  probes  under  the  high  levels  of  primary  task  workload  re- 
quired in  the  experiment.  At  this  writing  the  data  are  being  analyzed  and  it  is 
already  clear  that  there  is  a substantial  degree  of  individual  differences  in  the 
shape  and  temporal  characteristics  of  the  waveforms.  These  may  well  be  related  to 
different  strategies  that  subjects  adopt  in  performing  their  assigned  tasks,  and 
these  strategies  will  be  investigated  through  future  analysis  of  the  tracking  data 
ir  the  time  and  frequency  domain.  It  appears  however  that  there  is  some  consistency 
within  the  waveforms  of  a given  subject.  In  this  case  the  between-subj ect  variability 
presents  no  serious  difficulty  and  may  well  prove  useful  in  assessing  individual 
differences  in  performance.  In  a seuae,  calibrating  an  ERP  analyzer  to  the  physiolo- 
gical response  characteristics  of  an  individual  operator  imposes  no  greater  engineering 
demands  than  custom  designing  the  helmet  or  flight  suit  to  his  anthropometric  charac- 
teristics. 

At  this  point,  the  state  of  our  research  is  too  preliminary  to  draw  firm  conclu- 
sions concerning  the  effects  of  attentional  manipulations  upon  the  event-related- 
potentials.  However,  given  the  projected  importance  of  nondisruptive  measures,  and 
the  established  sensitivity  of  such  measures  to  certain  attentional  variations  in  the 
laboratory,  we  are  sufficiently  encouraged  to  pursue  the  direction  of  experimentation 
outlined  above. 
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C.4  Biocybernetic  Feedback  in  a CAI  Environment 

Computer  Assisted  Instruction  (CAI)  was  to  provide  an  individualized  learning 
environment  which  could  improve  both  the  rate  and  the  level  of  learning.  Early 
enthusiasm  has  waned  somewhat  as  the  great  expectations  were  not  fulfilled  (Watson, 
1972;  Jamison,  Suppes,  and  Wells,  1974).  A re-evaluation  of  the  underlying  initial 
assumptions  has  led  to  a diminution  of  dependence  on  the  analytic,  theory  based 
approach  to  the  design  of  CAI  materials.  Today  the  development  of  instructional 
materials  on  the  PLATO  CAI  system  generally  proceeds  according  to  e tistic  and 
empirical  methods  (Bunderson  and  Faust,  1976).  Often  used  together,  the  artistic 
approach  relies  on  the  early  intuitions  of  the  instructional  designer  to  assure 
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creation  of  quality  materia].,  and  the  empirical  approash  uses  a cycle  of  construc- 
tion, testing,  and  revision  in  order  to  produce  valid  instruction.  Botn  exploit  and 
explore  the  interactive  nature  of  the  medium,  emphasizing  its  ability  to  individualize 
the  questioning,  feedback,  and  routing  process  based  on  inputs  from  the  student 
(Avner,  1976;  Sternberg,  1975;  Nievergelt , 1975), 

Besides  the  practical  goals  of  producing  quality  instruction,  the  implicit 
g al  of  this  exploration  is  to  discover  new  theories  of  interactive  education.  We 
share  their  goal  ir.  our  attempt  to  add  bioc/bernetic  feedback  to  the  CAI  environment. 

C.4.1  Problem 

Ihe  acronyms  PLATO  and  TUTOR  (the  language  used  on  the  PLATO  system)  both  imply 
the  providing  of  a dialogue  context  between  the  student  and  the  computer  which  can 
offer  the  rich  interaction  that  exists  between  a human  tutor  and  student.  Both  human 
and  computer  tutors  will  always  have  ;-;om2  difficulty  communicating;  however,  the 
human  tutor  curre:  riy  has  both  a much  greater  capacity  for  understanding  the  student 
than  the  computer  does  and  can  achieve  a quantitatively  better  information  exchange 
ratio  than  the  computer  can.  CAI  systems  have  traditionally  been  t tapped  by 
their  inability  to  disambiguate  natural  language  inputs.  Both  the  eral  and  conno- 
tative  meanings  of  words  change  with  even  a slight  ch.?n;  a context.  The  TUTOR 
language  addresses  this  problem  by  providing  a uniquely  rich  selection  of  context 
establishing  procedures  for  evaluating  student  responses  (Tenczar  and  Golden,  1972; 
Sherwood,  1975).  Nevertheless,  understanding  even  simple  student  inputs  still  remains 
a time  consuming  process  for  the  developer,  and  results  in  oversized  instructional 
programs . 

The  other  disadvantage  of  CAI  is  that  its  Information  exchange  rate  is  still 
heavily  biased  in  favor  of  computer  to  student  interactions.  Sherw-'d  and  Stifle 
(1975)  have  reported  that  the  information  transfer  rate  for  a typical  PLATO  lesson 
is  approximately  100:1  in  favor  of  the  computer.  Because  of  the  overhead  for  analy- 
zing natural  language  inputs,  it  is  unlikely  that  quantitatively  increasing  student 
initiated  information  without  a qualitative  improvement  would  be  all  that  beneficial. 
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In  an  attempt  to  provide  such  qualitatively  different  information,  the  PLATO  system 
has  expanded  the  communication  modes  available  to  the  student  by  providing  typing, 
touching,  and  a variety  of  peripheral  devices  such  as  a joy  stick,  music  box,  and 
passenger  car  simulator  (Wood,  1975;  Trollip  and  Ortoney,  1976;  Peters  and  Colwell, 

1975;  Parker  and  Voss,  1975). 

We  will  attempt  to  improve  on  this  "bottleneck"  for  student-initiated  communica- 
tions by  providing  a biocybernetic  feedback  channel  which  can  transmit  information  to 
PLATO  about  the  attention,  expectation,  and  level  of  understanding  indicated  by  the 
student  along  with  traditional  communications.  Such  internal  "state"  indicators  which 
can  be  consciously  tapped  are  regularly  used  for  self-instruction,  and  the  non-verbal 
communication  channel  used  by  a human  tutor  receives  this  kind  of  information  through 
external  signs  exhibited  by  the  student,  such  as  changes  in  physical  posture  and 
voice  quality. 

Despite  the  expanded  exvironment  and  four  years  of  experimentation,  PLATO  instruc- 
tion has  yet  to  demonstrate  that  it  can  more  than  equal  the  accomplishments  of  tradi- 
tional classroom  instruction.  The  information  exchange  ratio  predicts  that  PLATO 
should  teach  about  as  well  as  a classroom  teacher.  Results  of  attitude  questionnaires 
indicate  that  students  enjoy,  and  often  prefer,  using  PLATO;  but  it  is  obvious  to 
them  that  CAI  has  not  yet  "arrived."  They  have  too  often  been  bored  or  frustrated 
by  simplistic  and  incomprehensible  questioning  sequences  which  are  unfortunately 
still  typical  of  much  instruction.  The  addition  of  biocybernetic  feedback  to  the 
PLATO  environment  could  help  move  PLATO  toward  its  goal  of  individualizing  learning. 

A similar  attempt  to  tap  the  student's  understanding  of  his/her  learning  state 
directly  has  been  to  place  the  learner  in  control  of  the  instruction  process  (Anastasio 
and  Morgan,  1972;  O'Neal,  1973;  Pask,  1976).  CAI  systems  such  as  TICCIT  (Bunderson, 
1973)  which  use  this  approach  place  the  computer  in  the  role  of  an  augmented  informa- 
tion retrieval  system,  and  require  that  the  student  make  operational  decisions.  The 
theory  behind  the  approach  asserts  that  the  student  will  makf  more  competent  selection 
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decisions  than  a computer  based  on  personal,  intuitive  knowledge  about  the  learning 
state;  and  will  gradually  develop  superior  learning  strategies.  Recent  experimenta- 
tion on  the  PLATO  system,  however,  indicates  that  students  select  their  initial 
learning  strategy  from  cues  such  as  the  indr'  '"angement,  and  do  not  change  this 
strategy  with  experience  (Elliott,  1976;  ..ahey , 1976).  Dwyer  (1975)  among  others 
has  discussed  the  need  for  careful  guidance  by  a human  teacher  or  a computer  in  order 
to  teach  learning  strategies.  The  student  state  information  which  can  be  provided  by 
biocybernetic  feedback  is  thus  needed  for  both  goals  in  the  CAI  environment,  and 
cannot  be  bypassed  by  placing  the  learner  in  control. 

C.4.2  Research 

Our  expectations  are  that  we  can  eventually  use  biocybernetic  feedback  to  improve 
CAI  on  all  levels:  student-computer  communication,  formative  evaluation  of  existing 

material,  teaching  learning  strategies,  and  the  development  of  theories  of  interactive 
instruction.  Our  initial  efforts  will  emphasize  the  augmentation  of  student-computer 
communication  in  four  areas,  1)  determining  mastery  of  drill  items  (rote  learning, 
simple  memorization  tasks),  2)  deciding  when  it  is  necessary  to  question  during  long 
textual  presentations,  3)  evaluating  the  instructional  success  of  specific  questions, 
and  4)  applying  the  results  of  applied  tracking  research  involving  measures  of 
effort  and  attention  measurement  to  dynamic  training  simulations. 

C.4.2.1  Drill 

This  investigation  will  explore  the  relationship  between  ERP  measures, 
performance,  reaction  times,  and  behaviorally  indicated  confidence  of  mastery,  with 
the  aim  of  using  the  student's  perception  and  evaluation  of  the  learning  task  to 
improve  the  rate  of  learning.  The  presence  of  the  P300  component  of  event-related 
potentials  has  been  repeatedly  correlated  with  variables  of  uncertainty,  expectancy, 
and  confidence  ( Squires  etal. , 1976;  Tueting,  1976).  By  using  this  component  as  an 
on-line  source  of  biocybernetic  feedback,  we  hope  to  obtain  information  about  the 
student's  confidence  in  the  correctness  of  a given  response. 

The  confidence  indication  will  be  used  to  supplement  a traditional  decision 
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model  for  drill  instruction,  such  as  the  one  used  by  Suppes  (Atkinson,  1972;  Suppes 
and  Morningstar,  1972)  to  teach  arithmetic  on  a CAI  system.  This  model  describes  the 
state  of  each  item  in  a drill  list  as  being  either  not  learned,  partially  learned,  or 
learned,  depending  on  how  many  sequentially  correct  responses  have  been  given  for  the 
item.  A criterion  level  is  defined  for  the  set  which  guarantees  at  least  90%  proba- 
bility of  mastery.  With  the  student  response  as  the  only  information  source,  such 
algorithms  guarantee  learning  by  the  "overkill"  method.  The  addition  of  biocybernetic 
information  could  optimize  the  application  of  this  algorithm  through  dynamic  adjustmei 
of  the  criterion  level  of  each  item.  Thus  the  program  could  abort  the  need  for  overt 
responding,  or  reduce  the  criterion  level  if  confidence  is  high;  and  raise  the 
criterion  level  if  the  uncertainty  reading  contradicts  performance  measures. 

C.4.2.2  When  to  Question 

By  using  ERP  measures  to  adapt  the  frequency  of  questioning  and  speed  of 
presentation  of  long  prose  passages,  we  will  attempt  to  improve  both  the  rate  and 
level  of  concept  learning.  Anderson  and  Biddle  (1976)  have  reviewed  the  research 
on  inserted  questions,  concluding  that  by  forcing  the  student  to  attend  to  more  than 
the  surface  structure  of  the  material,  questions  are  highly  effective  in  insuring  both 
immediate  attention  and  improved  retention.  But  questioning  for  this  purpose  is 
disfunctional  as  long  as  the  student  is  properly  attending  to  the  reading  material. 

We  will  attempt  to  continuously  monitor  the  attention  and  periodically  measure  the 
uncertainty  levels  of  a student  reading  an  extended  prose  passage.  A deterioration  in 
the  attention  level  of  the  student  will  be  used  as  a cue  for  initiating  a question, 
recommending  a break,  or  skipping  ahead  to  more  difficult  material.  High  uncertainty 
accompaning  the  reading  of  summative  passages,  will  be  used  as  a cue  for  inserting  a 
question  and/or  additional  explanations  to  insure  complete  learning  of  the  material. 

The  results  of  this  computer  controlled  systems  should  be  to  allow  the  student  to 

read  undisturbed  as  long  as  s/he  is  attending  effectively,  and  to  use  questions  only 
when  they  are  needed. 
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C . 4 . 2 . 3 Formative  Evaluation  of  Questions 

A second  area  of  interest  in  prose  learning  is  in  evaluating  the  effective- 
ness of  a specific  question  in  measuring  a student's  understanding.  Carroll  (1972) 
has  discussed  the  differential  processing  required  by  recall  and  recognition  question- 
ing modes,  and  Markle  (1973)  has  enumerated  some  of  the  problems  which  can  remain  in 
lessons  which  have  been  through  the  empirical  revision  process;  including  questions 
which  test  superficial  understanding  are  ambiguous,  or  test  question-answer  ability. 

We  will  evaluate  the  success  of  questions  in  operational  CAI  lessons  by  comparing 
the  level  of  processing  evoked  by  a question  with  the  confidence  that  a student 
indicates  in  the  correctness  of  his/her  response,  the  specified  response,  and  sur- 
prise at  subsequent  feedback.  A lack  of  processing  indicated  by  a large  number  of 
students  will  be  defined  as  an  unsatisfactory/unnecessary  question  whether  student 
responses  were  correct  or  incorrect.  An  indication  of  confidence  accompanying  an 
incorrect  answer  will  indicate  an  ambiguous  or  misleading  question.  Thus,  we  could 
unobtrusively  gather  new,  useful  information  about  the  importance  and  function  of 
inserted  questions. 

C.4.2.4  Improving  Communication  in  Dynamic  Simulations 

The  simulation  and  simulation/gaming  modes  of  instruction  have  been  the  most 
consistently  popular  and  successful  lessons  on  the  PLATO  system  (Hyatt,  Eades,  and 
Tenzar,  1972;  Grimes,  Burke,  North,  and  Friedman,  1974;  Smith,  Chesquire,  and  Avner, 
1974;  Neal,  1974).  Because  of  their  well  defined  context,  explicit  rules,  limited 
moves,  non-verbal  modes  of  interaction,  and  the  mathematical  nature  of  the  models, 
the  problems  of  disambiguating  student  responses  are  minimized.  Evaluation  of  student 
success  is  based  on  the  *.  t'iciency  in  manipulating  the  model  toward  well-defined 
goals.  Despite  their  general  success  as  training  tools,  simulations  to  date  are 
still  very  limited  in  their  adaptive  capabilities,  adjusting  parameters  in  real  time  to 
correspond  with  students'  performance  and  rate  of  progress.  These  limitations  seem 
to  result  primarily  from  the  inability  to  obtain,  with  tradicional  measures,  high 
quality  information  about  the  student  quickly  enough  to  make  effective  adaptive 
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decisions.  The  techniques  developed  in  our  applied  tracking  research  program  will 
be  applied  to  the  CAI  instructional  environment.  Research  measures  of  attention, 
effort,  and  processing  levels  will  be  used  to  provide  performance  feedback  to  the 
student,  and  to  adapt  the  parameters  of  the  simulation  to  the  competency  of  the 
student. 

For  example,  the  driving  simulation  described  by  Parker  and  Voss  (1975) 
provides  a continuous  experience  in  which  a student  uses  wheel  and  pedal  controls 
to  demonstrate  understanding  of  the  driving  task.  Hazards,  road  signs,  and  other 
changes  in  the  driving  environment  can  be  selectively  included  in  the  display.  By 
measuring  the  attention  that  a student  gives  to  a new  stimuli  such  as  a caution  sign, 
and  comparing  it  to  performance  when  the  hazard  actually  appears,  we  may  be  able  to 
identify  the  foresight  that  a student  had  into  the  driving  context,  and  use  this 
information  to  assist  in  the  evaluation  of  performance  and  the  selection  of  future 
stimuli.  The  degree  of  attention  required  for  correct  performance  will  also  allow 
us  to  predict  the  students'  mastery  over  a specific  context.  So  with  the  addition 
of  biocybernetic  feedback  the  simulation  should  be  able  to  adapt  to  the  competency 
of  the  student  dynamically  and  efficiently. 
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SECTION  D 

EXPERIMENTAL  REPORTS 


In  this  section  we  include  copies  of  several  reports  which  describe  xn 
detail  experimental  and  theoretical  work  conducted  with  the  support  of 
this  program. 

The  reports  are  briefly  described  here. 

1X1  Squires,  K.  C.,  Sickens,  C. , Squires,  N.  K. , and  Donchin,  E.  The  effect  of 
stimulus  sequence  on  the  waveform  of  the  cortical,  event-related  potential. 
Science , 1976,  in  press. 

Describes  our  discovery  of  the  effects  of  sequential  dependencies  on  P300 
amplitude  and  presents  the  Expectancy  model. 

Squires,  N.  K.  , Donchin,  E.,  Squires,  K.  C.,  and  Grossberg,  S.  Bisensory 
stimulation:  Inferring  decision-related  processes  from  the  P300  component 

Journal  of  Experimental  Psychology,  1976,  in  press. 

A demonstration  that  the  P300  can  be  used  to  infer  which  of  two  channels 
of  information  are  processed  by  a subject.  The  data  also  reinforce  our  notion 
that  P300  represents  stimulus  evaluation  rather  than  response  selection  processes. 

HlJL  McCarthy,  G. , and  Donchin.  E.  The  effects  of  temporal  and  event  uncertainty 
in  determining  the  waveforms  of  the  auditory  event  related  potential  (ERP). 
Submitted  to  Psychophysiology. 

A demonstration  that  P300  is  enhanced  by  the  resolution  of  event  uncertainty 


rather  than  by  temporal  uncertainty. 
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Kutas,  M. , and  Donchin,  E.  Variations  in  the  latency  of  P300  as  a function 
of  variations  in  semantic  categorizations.  In  D.  Otto  (Ed.),  Proceedings 
°L  EPIC  IV-  Washington,  D.C.:  Government  Printing  Office,  1976,  in  press. 

Describes  the  first  experiment  in  which  we  used  the  PLATO  terminal. 
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The  Effect  of  Stimulus  Sequence  on  the  Waveform  of 
the  Cortical  Event-Kelated  Potential 


Abstract.  7 lie  waveform  of  the  cortical  event-related  potential  is  extremely  sensi- 
tive to  variations  in  the  sequence  of  stimuli  preceding  the  eliciting  event.  Hie  wave- 
fvnn  changes  were  manifested  primarily  in  the  amplitudes  of  the  negative  corn-  > 
ponent  of  the  potential  that  peaked  at  200  milliseconds,'  'the  positive  component  that  t' 
peaked  at  300  milliseconds,  tool  slow-wave  component \.  A quantitative  model  was  f};_T 
developed  relating  the  waveform  changes  to  changes  in  event  expectancy.  Expec- 
tancy is  assumed  to  depend  on  a decaying  memory  far  events  within  the  / trior  se- 
quence, the  specific  structure  of  the  sequence,  and  the  global  probability  of  event 
ocean encr.  Ear  stimuli  relevant  to  the  task,  the  less  expected  the  stimulus  the  larger 
the  ampUlndcs  of  late  components  of  the  event-related  potentials. 


The  cortical  event-, elated  potential 
(ERP)  associated  with  .he  rare  outcomes 
of  Bernoulli  trials  that  are  relevant  to  a 
task  is  dilVerent  from  that  associated  with 
the  frequent  outcomes  (1-3 1.  If,  for  ex- 
ample, a subject  is  instructed  to  count 
the  occurrences  of  a few  low-pitched 
tones  embedded  in  a scries  of  high- 
pitched  rones,  the  low-pitched  tones  elic- 
it ERP's  characterized  by  a large  nega- 
tive component  peaking  at  200  mse< 
(N200).  a large  positive  component  peak- 
ing at  300  msec  (P300),  and  large  “slow- 
wave"  (SW)  components  (3)  The  dis- 
tinction between  the  types  of  ERP  wave- 
forms made  it  possible  for  us  to  develop 
a discriminant  function  in  which  ERP's 
to  individual  tunes  were  classified  as 
“rare"  or  “frequent"  (•/).  When  a “cor- 
rect” classification  was  defined  as  the 
categorization  of  an  ERP  elicited  by  a 
rare  tone  as  “rare"  and  by  a frequent 
tone  as  "frequent."  the  discriminant 
function  formed  from  the  ERP  data  of 
one  group  of  subjects  correctly  classified 
SI  percent  of  all  ERP’s  from  a group  of 
new  subjects.  Although  the  classification 
technique  was  successful,  the  reasons 
for  misclassifying  19  percent  of  the  trials 
remained  unclear  An  analysis  of  the 
wa vel'ot ms  associated  with  the  ntisclassi- 
licatiuns  suggested  that  the  erroneous 
classifications  reflected  systematic  tiial- 
to-tnal  variations  in  the  ERP  waveforms. 
Some  of  the  "rare"  events  seemed  to 
elicit  a "fiequent"  wavefonn.  and  vice 
vcisa  (.5).  Since  the  underlying  assump- 
tion of  research  involving  ERP's  is  that 
the  ERP's  elicited  by  all  occurrences  of  a 
particular  lype  of  event  are  identical, 
such  t rial  - to  trial  variations  in  the  ERP 
required  further  examination. 


Inspection  ol  tlic  iijul  in  tn.il  w . , v c- • 
I'"11'  measures  suggested  Hut  Hie 
turns  might  have  been  due  to  sli  ut  lenu 
sequential  de|viidciieies,  Remington  (6) 
and  qtlicis  (7  10)  have  demonstrated  se- 
quential dependencies  in  choice  tas«s,  in 
which  reaclior  lime  (Rf>  on  any  given 
hinl  is  sensitive  to  the  specific  sequence 
of  picceding  events.  I hese  sequential  el 
fects  have  been  atliihntcd  hy  some  to  tii- 
ai-to-lrial  changes  in  the  subject's  expec- 
tancies (9.  10).  Since  expectancy  has 
been  implicated  as  one  determinant  of 
the  ERR  waveform,  we  attempted  to  dc- 
tciminc  whcllici  the  waveform  of  the 
tRP  exhibits  similar  sequential  depen- 
dencies. 

•Seven  subjects  listened  to  series  of  icg- 
ularly  presented  tone  bursts.  On  each  tri- 
al a high-pitched  and  a low-pitched  tone 
were  equally  likely  to  occur  (//)  The 
subject  was  instructed  to  count  the  high- 
pitched  tones  silently  and  to  report  the 
count  after  each  blcvck  of  200  trials.  In  a 
second  condition,  the  probabilities  ol  the 
high  and  low-pitched  tones  were 
changed  to  .3  and  .7.  respectively  (/2). 
Each  , subject  was  tested  on  800  to  1600 
trials,  depending  on  the  condition. 

During  testing,  the  subject  was  com- 
fortably seated  in  a reclining  chair  in  a 
well-lighted  experimental  room.  The 
electroencephalogram  (F.EG)  was  re 
corded  with  Ihudcn  Ag-AgCI  electrodes 
from  I',.  C„  and  I’,  (according  to  the  10- 
20  system)  which  were  referred  to  a 
linked  nastnid  electrode,  with  a wrist 
ground.  The  hand  pass  of  the  amplifier 
system  was  set  for  a time  constant  of  0.8 
second  and  an  upper  half-amplitude  fre- 
quercy  of  35  hertz.  Additional  elec- 
trodes (Heckman)  were  situated  above 
and  on  the  outer  margin  of  the  right  eye 
to  record  eye  movement  and  blink  poten- 
tials. On  each  trial,  a 768-msec  epoch  of 
the  EECi.  beginning  100  msec  before  the 
stimulus  onset,  was  digitized  from  each 
ol  the  recording  channels  (at  a rate  of 
one  sample  every  3 msec)  and  stored  on 
digital  magnetic  tape.  The  EEG  epochs 
contaminated  with  eye  movement  or 
blink  artifacts  were  excluded  from  the 
subsequent  waveform  analysis.  All  trials 
entered  into  the  tabulations  of  se- 
quences. 


Remington  s terminology  (6)  will  be 
followed.  An  a.  represents  whichever 
stimulus  event  occurred  on  trial  N (a 
first -order  sequence).  I or  the  second  or 
der  sequences  there  were  2 possible  pat- 
terns of  stimuli  on  trials  N- 1 and  A',  aa 
or  n x.  Similarly  there  were  4 possible 
thud  order  paticms  (aaa,  maa.  aha,  or 
miv),  8 foui tli-order  patterns,  and  16 
lift  hoi  dci  patlems.  When  sequences  ter- 
minated with  a high  pitched  lone,  an  a in 
■i  sequence  rcpicsents  the  occurrence  of 
a high-pitched  tune  and  a u that  of  a low- 
pilclicd  lone.  When  the  sequences  tenni 
mile  with  a low-pitched  tune,  the  labels 
■lie  lev ci sell  A vvavclortn  nieasmc  can 
he  plotted  foi  each  ol  the  possible  se- 
quences and  a lice  di.  glam  coiisli uctcd 
by  comiccling  the  points  in  each  older  to 
Hie  i elated  points  in  the  liighei  ami  lower 
oidc-s  | or  instance,  the  thud  tinier  sc 
qnen.e-  u-  t ami  n>.  v .i,c  u-|..;,j  m rhe 
second  n-tlei  sequence  n\  hy  ihe  occur 
leiite  nl  cither  an  v ui  a n tin  trial  M 2. 

III. niche',  at  each  mule,  which  svsieni 
ahcallv  divetgc  to  high  oitleis.  indicate 
thlleicnlial  ellccis  til  the  pn-cetluig  stiiim- 
h in  the  sequence  uu  the  t.cponleul  v an- 
able  on  Inal  ,V  d ig.  |) 

I he  averaged  ERR  vvavetonus  (Imiu 
C ,)  I oi  Hie  sequences  of  Hie  oiitci  limbs 
ol  the  lice  stiuctuie  aie  shown  lm  one 
snhiect  in  I ig  7.  I.aige  thsci  iminanl 
seines  icllecl  huge  IMHO  components 
(ami  the  associated  N200  and  SW  com- 
ponents) riieic  is  systematic  vaiiatiun 
in  Hie  wavcluiiii  ol  Hie  ERI’asa  function 
uf  the  sequence  ol  pieeeiling  siiniiih.  The 
si/c  til  Hie  IMHO  complex  elicited  by  an  a 
me i eases  wuli  Hie  miinbci  of  n stimuli 

that  piccedc  it  (the  ascending  limb  of  the 
Heel,  ami  the  si/e  til  the  IMHO  complex 
tleei cases  as  inns  of  v siimuh  of  inereas- 
ing  length  pieccde  a given  a.  The  indii 
ence  of  pi ecetling  stimuli  on  the  ERR 
elicited  on  trial  N extends  at  least  i0  trial 
W *f  dig.  la)  t/.t).  The  discriminant 
score  variations  seem  to  result  mainly 
liom  amplitude  changes  of  the  waveform 
components  and  nol>f  large  shift-  in  In- 
A tencics  ol  the  compoil^nts  d ig.  2) ('•/) 
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in  the  unequal  probability  condition 
(.3/, 7),  the  Irce  structures  for  ths  high- 
and  low-pitched  (ones  arc  displaced  (Pig. 
I.  b and  c).  The  discriminant  scores  lor 
each  sequence  tire  generally  larger  for 
the  stimuli  with  a low  probability  and 
smallei  for  those  with  a high  probability 
(15).  The  average  displacement,  how- 
ever. is  no  larger  than  the  lange  of  the 
discriminant  scores  observed  for  fifth-or- 
der sequences  in  each  of  the  panels  (Fig. 
I).  The  sequential  determinants  of  wave- 
form variability  seem  to  be  at  least  as  po- 
tent as  the  determinants  of  (he  ERP 
waveform  associated  with  changing  lev- 
els of  stimulus  probability. 

The  tree  structure  reported  here  is  sim- 
ilar (o  the  RT  trees  of  Remington  (ft)  and 
hiiltnagnc  el  ill.  (7).  The  analogous  ef- 
fects in  the  two  cases  are  the  enhance- 
ment of  (lie  IMDO  complex  and  the  prolon- 
gation ol  RT  with  longer  sequences  of 
preceding  n's.  If,  as  has  been  argued  (9), 
RT  increases  as  an  inverse  function  of  ex- 
pectancy. a simil  ,i’  relationship  between 
expectancy  and  ERP  waveforms  can  be 


assumed.  We  proceeded,  therefore,  to 
develop  a model,  based  on  the  concept 
of  expectancy  to  describe  the  sequential 
dependencies  in  ERP  waveform. 

In  serial  RT  tasks,  when  the  inter) rial 
interval  is  less  than  2.0  seconds,  the  ef- 
fect of  a stimulus  sequence  on  tire  expec- 
tancy of  a stimulus  event  is  presumed  to 
function  as  follows.  The  subject  forms  a 
local  (as  opposed  to  a global)  subjective 
probability  distribution  that  reflects 
went  frequency  within  a “sliding  win- 
dow." The  more  fiequently  an  event  oc- 
curs within  that  window,  the  greater  is 
the  subjective  probability  (expectancy) 
that  the  event  will  recur.  When  the  next 
cvcnl  in  the  sequence  confirms  the  ex- 
pectations  induced  by  the  piobaliility  dis- 
tribution. R I tub*  is  shorlei  than  if  the 
less  expected  event  occurs. 

In  oiu  experiment,  the  amplitude  of 
lb:  I’llMl  complex  (as  mcasuicd  by  the 
discriminant  sane)  seems  to  be  huger 
when  the  expectation  is  disconlirmcd 
than  when  it  is  confirmed  by  the  eliciting 


event  I Inis,  a model  accounting  |,>i  the 
wavetoim  data  shotih'  estimate  the  ex- 
pectancy the  subject  has  lot  air  event  as 
a function  ol  the  preceding  sequence  of 
stimuli  We  assume  expectant)  to  he  tie 
lei  mined  in  a linear  additive  ishmu  by 
lliicc  factors:  (i)  (he  mcmoiy  foi  event 
I requeue  y within  the  poor  stimulus  se- 
quence. |ii)  the  specilic  stmcime  of  the 
prior  sequence,  and  (iii)  the  global  proba- 
bility of  the  cv  ent. 


Die  assumption  that  the  ocally  oper- 
ating. subjective  probability  distiihution 
depends  on  a sliding  wndnv  implies  that 
the  magnitude  ol^elfcct  of  a stimulus  on 
the  expectancy  for  succeeding  stimuli  is  f 
a decaying  function  of  sequential  posi- 
tion (or  time)  (10).  We  assume  that  the  ef- 
fect of  a stimulus  on  responses  to  suc- 
ceeding stimuli  is  governed  by  an  expo- 
nential decay  process  (9)  The  specific 
form  of  the  “memory"  (A/)  expectancy 
function  for  event  a on  trial  A'  as  a func- 
tion of  the  sequence  of  past  events  S,  is 
assumed  to  be 

N hi 

= V «'  'S,  (I) 

» •*  \ f 

where 

Ofor(.A,  = n) 

S,  = 

I I'orl.V,  - a) 


and  where  m equals  the  order  of  the  se- 
quence (here,  m - 5).  The  constant  u 
corresponds  to  the  rate  of  decay  in  mem- 
ory of  prior  stimulus  information 
(0  - /y  ''  I):  small  values  of  o indicate 
that  only  very  recent  events  contribute 
to  expectancy  (,'ft). 

Alternations  a the  stimulus  sequence 
gcneiatc  expectancies  that  the  alterna- 
tion pattern  will  continue  ( 10.  17).  With 
regard  to  alternations,  our  model  as- 
sumes that  ti)  a positive  expectancy  is 
generated  for  the  stimulus  on  trial  N that 
fits  the  alternation  pattern,  and  a nega- 
tive expectancy  is  generated  for  one  that 
breaks  the  pattern;  (ii)  the  magnitude  of 
the  alternation  factor  should  grow  (lineal  - 
ly) with  the  number  of  consecutive  prior 
alternations;  and  (iii)  a minimum  of  two 
prior  alternations  are  necessary  to  in- 
duce an  alternation  set.  Thus,  each  stim- 
ulus sequence  was  assigned  an  alterna- 
tion factm /((.V,),  whose  value  ( 3 to  >-3) 
was  gcneiaicd  by  these  assumptions 
(IX) 

I lie  pi  obahility  (/')  that  a stimulus  w ill 
occiii  .iflccts  the  discriminant  score  iiulc- 
pcmlcotl)  of  sequential  ellects  (big.  I).  It 
may  be  conceived  of  as  a reflection  of 
long  term  memory,  oi  as  a nori/cio 
asymptote  ol  the  decaying  short-  cim 
nicuiotv  piocess  that  governs  the  mine 
1 event  sequential  etleets  Snuilai  ellects 
ol  global  piohalnlit)  opciatc  on  icaUion 
times  (A,  7).  We  assumed  that  the  three 
determinants  ol  expeclanev  <W(S  .«»). 
At.S.I.  and  /')  combine  linc.iily  and  iii  an 
additive  l.ishum  to  eniili ibule  to  tnciall 
event  expectancy  mil.  thcrcloic.  lo  |ue- 
dicl  the  magnitude  of  the  discriminant 
seme. 


eo< 


We  lii si  dctCMiuiicrl  line  nicnioi y dee.iy 
coiistanl  >>  in  i:»|.  I ili.il  would  pi  ovule 
the  best  Iurmi  rul.il itnisliip  between  th\- 
«.'i  ill  ii  n:>  n I semes  and  I lie  niemoiy  cxpec 
liincy  laetoi  lor  line  probability  coiuli- 
lions,  /’  I.  S,  or  , 7 . I lie  value  of  o 
Hull  ni.ixiini/cd  Hie  lineal  con  elation  lie 
tween  \l  ;nul  Hie  discimniiant  secies  did 
not  dilter  among  the  tliice  eoudilinns 
(10).  I lie  mean  value  of  o.  0.6.  w;is  thus 
seleeled  as  the  niemoiy  decay  rule  lor  oil 
conditions. 

We  I'erfoi  nied  ;i  nmliiple  linear  regies- 
sion  ;in;ily.si.s  in  order  to  determine  liic 
equation  relating  the  vnliies  of  the  lifih- 
ordcr  tliseriniin.int  scores  to  M,  /*,  and 
A: 

Expectancy  - 0.2 XW  i 

0,0. VVl  i 0.505/*  --  0.027  ( 2) 

In  l ig.  5,  the  observed  expectancies 
(measured  ;is  discriminant  scores)  for  all 
three  probability  conditions  arc  plotted 
as  functions  of  the  expectancy  values  de- 
rived from  Eq  2 (20).  The  regression 
equation  accounted  for  approximately  78 
percent  of  the  variance  (//  ~ .KK I » (2/). 

The  multiple  regression  analysis  was 
repeated  with  pairs  of  factors  to  evaluate 
the  incremental  proportion  of  variance 
accounted  for  by  each  factor.  The  largest 
gains  were  added  by  including  the  /’  (58 
percent)  and  M (49  percent)  factors;  a 
small  predictive  increase  was  gained  by 
including  A (5  percent)  (22)  Alternations 
occurred  in  only  a small  number  of  se- 
quences <4  of  |6)  and  their  effect  on  the 
ERP  waveform  counters  attempts  to  ex- 
plain these  results  in  terms  of  habit- 
uation. If  the  mere  occurrence  of  a stimu- 
lus affects  all  subsequent  stimuli  through 
habituation,  the  precise  pattern  of  stimu- 
li within  a sequence  should  not  material- 
ly affect  the  results. 

Our  m oriel  extends  hypotheses  pre- 
viously advanced  to  account  for  the  ef- 
fects of  event  probabilities  on  the  wave- 
form of  ERPs  (2J).  The  amplitude  of  the 
P500  complex  increases  as  the  expec- 
tancy of  a stimulus  decreases,  and 
multiple  factors  combine  to  determine 
the  expectancy  that  the  subject  asso- 
ciates with  individual  stimuli,  Morcovei , 
the  effect  of  expectancy  can  be  inferred 
to  be  related  to  dynamic  processes  that 
develop  over  short  progressions  of  stimu- 
li spanning  lime  intervals  of  only  a few 
seconds.  Thus,  caution  should  be  exer- 
cised in  the  interpretation  of  changes  in 
_thc  waveform  of  "ie  aveiage  ERI*.  The 
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validity  of  Hie  common  assumption  that 
the  average  is  computed  over  a liomoge 
norms  data  set  must  be  caiefuMy  evaluat- 
ed for  each  experiment  l or  example, 
whenever  the  global  probability  of  an 
event  is  inci  cased.  Iliei e is  a eoi i espous- 
ing increase  in  the  number  o runs  of  that 
stimulus  in  the  senes.  If  tnals  in  such  a 
senes  aif  avciagc'd  without  legaitl  to 
their  serial  position,  the  incioasetl  pin 
portion  ol  trials  following  long  runs  of 
like  stimuli  niuv  well  letluce  the  ampli 
tilde  of  the  Plot)  complex.  Also.au  exam 
illation  ol  the  behavioi  of  the  discrimi- 
nant semes  obtained  in  our  picvions 
wank  on  the  classification  of  single-trial 
I'.RP's  (•/)  suggests  that  many  of  the  ci- 
rrus of  classification  may  have  been  tine 
to  seqiionli.il  effects. 

It  is  li.iirfly  suipiisutg  In  li/ul  ||,al  the 
oigaiiisiu's  i espouse  to  "idcniir ail"  Mini 
nil  is  in  lln  v | In-  „ci  v mis  system  is  not  a 
passive  i capital!  ol  inputs  that  ,ue  ohcrli- 
cully  switched  lo  oillpuls  lathci  ii  i\  ;i 

dynamic  system  Hiaf  toufin isly  gone. 

ales  liv l" 'Hie sc s about  llig  euv u oiimciil 
I lie  nun  seems  to  be  associated  .sitli  Hie 
evaluation  ol  such  coiiievlu.il  hypothe 
ses 

Ki  nm  i ii  (.  S171  no  s' 
Cnuisioi  in  it  Wit  k i ns 
N vni  v \ St;i  imi  s 

I'  XI  VNI  | | |)o,N(  MIN 
lh /HU Inn  III  n I /‘wr/n./ogv, 

1 ’nil  truly  nl  I Ilium 
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cept for  the  constraint  that  each  stimulus  oc- 
curred with  a probability  of  .5 

12  Subjects  were  tested  in  the  unequal  probability 
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tions. being  maximum  for  the  P .5  condition 
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ABSTRACT 

Three  experiments  were  conducted  to  evaluate  the  P300  component  of  the  human 
evoked  response  as  an  index  of  bisensory  information  processing.  On  different  blocks 
of  trials  subjects  were  presented  with  auditory  stimuli  alone,  visual  stimuli  alone 
or  with  audio-visual  compounds.  In  each  series  there  were  two  possible  stimuli,  one 
of  which  was  presented  less  frequently  than  the  other;  the  subjects'  task  was  to  count 
the  infrequent  ntimuli.  In  the  first  two  experiments  the  information  in  the  two 
modalities  was  redundant  while  in  the  third  the  modalities  provided  non-redundant 
information.  With  redundant  information,  the  P300  latency  indicated  bisensory  facili- 
tation when  the  unimodal  P300  latencies  were  similar;  when  the  unimodal  latencies  were 
dissimilar,  the  bisensory  P300  occurred  at  the  latency  of  the  earlier  unimodal  P300. 
Reaction  times  paralleled  P300  latency.  When  the  information  in  t.he  two  modalities 
was  non-redundant  both  P300  amplitude  and  reaction  time  data  indicated  interference 
between  the  two  modalities,  regardless  of  which  modality  was  task  relevant.  P300 
latency  and  reaction  time  did  not  covary  in  this  situation.  These  data  suggest  that 
P300  latency  and  amplitude  do  reflect  bisensory  interactions,  and  that  the  P300 
promises  to  be  a valuable  tool  for  assessing  brain  processes  during  complex  decision 


making . 
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INTRODUCTION 

The  P300  component  of  the  event-related  brain  potential  (ERP)  which  can  be  re- 
corded from  the  human  scalp  seems  to  be  a sensitive  measure  of  information  processing 
(see  Price  and  Smith,  1975,  for  a bibliography).  Since  the  P300  is  a multifaceted 
measure  whose  amplitude,  latency  and  distribution  over  the  scalp  may  be  independently 
determined  by  different  aspects  of  the  cognitive  process,  it  might  well  prove  to  be 
a richer  measure  than  such  traditional  indices  of  processing  as  reaction  time  (RT) 

[for  example,  P300  latency  may  index  the  time  of  occurrence  of  a cognitive  process 
(Kutas  and  Donchin,  in  press),  its  scalp  distribution  may  index  the  nature  of  the 
task  (Courchesne,  Hillyard,  and  Galambos,  1975),  while  P300  amplitude  may  index 
expectancy  for  the  eliciting  event  (Donchin,  Kubovy,  Kutas,  Johnson,  and  Herning, 

1973;  Squires,  K. , Wickens,  Squires,  N.  , and  Donchin,  in  press)  ] > especially  since 
the  ERP  can  be  used  to  assay  ongoing  cognitive  processes  without  requiring  an  overt  re- 
sponse by  the  subject.  For  example,  Squires,  K.,  Wickens,  Squires,  N.  , and  Donchin 
(in  press)  demonstrated  that  P300  amplitude  reflects  rapid  changes  in  a subject's 
"expectancies"  which  parallel  the  effects  of  sequential  dependencies  between  reaction 
times  (Falmagne,  Cohen,  and  Dwivedi,  1975;  Remington,  1969).  The  P300,  however,  re- 
vealed these  expectancy  fluctuations  during  a task  which  required  no  overt  responses. 

Despite  the  potential  utility  of  P300  and  other  ERP  measures,  f^v  attempts  have 
been  made  to  utilize  the  growing  body  of  knowledge  about  cognition  in  identifying  the 
functional  determinant t.  the  various  ERP  components  or  to  utilize  P300  in  clarifying 
issues  of  human  information  processing.  The  procedures  and  terminology  of  the  two 
research  areas  have  remained  largely  distinct.  There  is  a clear  need  for  experiments 
which  use  paradigms  from  the  information  processing  literature  to  evaluate  the  utility 
of  the  ERP  as  a measure  of  complex  processes.  Such  experiments  are  also  likely  to 
help  clarify  the  functional  significance  of  F300. 

Two  issues  are  specifically  addressed  in  the  experiments  reported  here.  The 

first  concerns  the  ERP  manifestations  of  r..e  way  in  which  subjects  deal  with  multiple 
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sources  of  information.  Our  work  most  clearly  follows  that  of  Garner  and  his  co- 
workers (see  Garner,  1974,  for  a review)  who  have  shown,  using  multi-dimensional 
stimuli , that  the  nature  of  the  dimensions  nr  information  channels,  as  well  as  their 
redundancy,  determines  the  manner  in  which  the  subjects  process  the  information.  The 
second  and  third  experiments  are  particularly  relevant  to  this  issue. 

The  second  related  area  of  interest  is  the  relationship  of  P3U0  and  reaction 
time  measure.  Previous  research  suggests  that  P305  latency  and  RT  sometimes  cnvary, 
longer  RTs  being  associated  with  longer  P300  latencies  (e.g.,  Picton,  Hillyard,  and 
Galambos,  1974;  Ritter,  Sirason,  and  Vaughan,  1972;  Rohrbaugh,  Donchin,  and  Eriksen, 
1974).  Other  investigators  report  stable  P300  latencies  despite  varying  RTs  (e.g., 
Karlin  and  Martz,  1973;  Squires,  K.  , Wickens,  Squires,  N.,  and  Donchin,  in  press). 

Since  reaction  time  appears  to  be  multiply  determined  (Felfoldy,  1974)  it  may  be  the 
case  that  only  some  of  the  variables  affecting  reaction  time  also  influence  the  P300 
(e.g.,  Wilkinson  and  Spence,  1973).  Experiment  III  was  concerned  with  this  problem. 

As  these  studies  required  the  simultaneous  presentation  of  auditory  and  visual 
stimuli,  the  initial  step  was  to  determine  the  feasibility  of  analyzing  the  contribu- 
tion of  each  element  to  the  bisensory  ERP . Previous  studies  have  generally  employed 
sample,  non- s imu 1 1 an eo u s sensory  events,  assuming  that  the  simultaneous  occurrences  of 
more  than  one  event  would  make  interpretation  of  the  ERP  difficult,  leading  to  sericus 
restrictions  or.  the  procedures  that  can  be  examined  via  ERP  techniques.  The  first 
experiment,  then,  investigated  the  dissociability  of  the  effects  of  two  simultaneously 
presented  stimuli.  To  facilitate  interpretation,  only  redundant  information  was  used 
in  tlis  initial  experiment. 


EXPERIMENT  I METHODS 

_Subj_ec_ls.  Six  normal  adults  (ages  18-32,  3 female  and  3 male)  including  experi- 
menters NS  and  KS,  served  as  subjects.  The  volunteer  subjeccs  were  paid  for  their 
participation.  (NS  and  KS  appear  as  subjects  "1"  and  '2M  in  all  figures  and  tables.) 
St imuli . The  auditory  stimuli  were  80  dB  SPL  tone  bursts  delivered  binaurally 
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through  TDH-39  earphones  against  a continuous  background  of  white  noise  at  55  dB  SPL 
at  a rate  of  one  every  1.3  sec.  Two  tone  frequencies  were  used,  1000  Hz  and  1500  Hz. 
Each  tone  burst  was  60  msec  in  duration  including  10  msec  rise-fall  times.  The  visual 
stimuli  were  presented  via  two  fields  of  an  Iconix  model  6137  four-field  tachistoscope 
and  were  50  msec  in  duration.  A left-pointing  and  right-pointing  arrow  were  outlined 
in  black  (visual  angle  of  1°)  on  a blank  white  field  (visual  angle  of  6°).  The 
.uminance  of  these  fields  was  20  ft-L,  measured  wich  a Lpectra  brightness  spot  meter. 

Recording  System.  The  EEG  was  recorded  from  5 electrode  sites  (Oz,  Pz,  Cz,  Fz, 
and  FPz  according  to  the  10-20  system)  referred  to  linked  mastoids.  The  ground  elec- 
trode was  on  the  back  of  the  right  hand.  Burden  Neurological  Institute  Ag-AgCl  elec- 
trodes affixed  with  collodion  were  used  for  scalp  recording.  Beckman  Biopotential 
electrodes  were  used  for  the  reference  and  ground  electrodes.  In  addition,  right 
supra-orbital  and  canthal  electrodes  were  used  to  record  the  electrooculogram.  Sub- 
jects were  instructed  not  to  move  their  eyes  excessively,  and  the  averaged  EOG  indi- 
cated that  eye  movement  artifacts  were  indeed  negligible. 

The  EEG  was  amplified  with  Grass  7P122  amplifiers  (time  constant  0.8  sec  and 
upper  half-amplitude  frequency  35  Hz)  and  was  sampled  for  768  msec  beginning  100  msec 
prior  to  stimulus  onset  at  a rate  of  one  sample  every  3 msec. 

Data  Collection.  Stimulus  presentation  and  data  collection  were  under  the  control 
of  a PDP  11/40  computer  (see  Donchin  and  Heffley,  1975).  The  data  acquisition  was 
monitored  on-line  and  the  averaged  ERPs  for  each  stimulus  type  for  each  block  of 
trials  were  stored  on  digital  magnetic  tape  for  later  analysis. 

Procedure.  Bernoulli  trials  were  presented  in  blocks  of  >.50.  In  each  block,  one 
of  the  two  possible  outcomes  had  a 0.10  probability  of  occurrence  (the  "rare"  stimulus) 
and  the  other  had  a 0.90  probability  of  occurrence  (the  "frequent"  stimulus).  The 
subject,  seated  in  a reclining  chair,  was  as.-ed  to  count  the  number  of  rare  stimuli  in 
each  block,  to  be  reported  at  the  end  of  the  block.  In  all  the  experiments  counting 
performance  was  virtually  perfect. 

There  were  seven  different  experimental  conditions  in  which  the  stimuli  were  either 
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unimodal  or  bimodal:  1)  auditory  stimuli  with  a frequent  1000  Hz  tone  and  a rare 

1500  Hz  tone;  2)  auditory  stimuli  with  the  probabilities  of  the  two  stimuli  reversed; 

3)  visual  stimuli  with  a frequent  left-pointing  arrow  and  a rare  right-pointing  arrow; 

4)  visual  stimuli  with  the  probabilities  of  the  two  stimuli  reversed  (conditions  2 
and  4 served  only  to  confirm  that  the  P300  was  related  to  stimulus  probability  and 
Will  not  be  discussed  further);  5)  bimodal  ,•  timuli  with  the  frequent  stimulus  being 
the  simultaneous  presentation  of  the  1000  Hz  tone  and  the  left  arrow,  and  the  rare 
stimulus  being  the  compound  of  the  1500  Hz  tone  and  the  left  arrow  ("variable  auditory  - 
constant  visual'');  6)  bimodal  stimuli  with  the  frequent  stimulus  being  the  1000  Hz  tone 
and  left  arrow  and  the  rare  stimulus  being  the  1000  Hz  tone  and  right  arrow  ("constant 
auditory  - variable  visual");  and  7)  bimodal  stimuli  with  the  frequent  stimulus  the 
1000  Hz  tone  and  the  left  arrow,  and  the  rare  stimulus  the  1500  Hz  tone  and  right 
arrow  ("variable  auditory  - variable  visual").  Thus  in  this  last  condition  the  infor- 
mation supplied  Toy  the  two  modalities  was  redundant. 

The  subject  was  informed  prior  to  each  block  of  trials  which  stimuli  would  be 
presented.  Each  type  of  series  was  presented  twice  to  each  subject  in  the  course  of  a 
two— hour  session  so  that  each  rare— stimulus  ERP  was  the  average  of  approximately  30 
trials.  The  order  of  presentation  was  counter— balanced  across  subjects. 

RESULTS 

P30Qs  to  unimodal  stimuli.  As  in  previous  studies  (e.g.,  Ritter  and  Vaughan,  1969; 
Ruchkin  ard  Sutton,  1^73;  Squires,  N.,  Squires,  K. , and  Hillyard,  1975;  Tueting,  Sutton, 
and  Zubin,  1971)  the  rare  stimuli  elicited  large  P300  components.  This  is  shown  in 
Figure  1 where  the  ERPs  associated  with  the  rare  and  frequent  auditory  stimuli  are 
superimposed  on  the  left  column,  and  the  ERPs  to  the  rare  and  frequent  visual  stimuli 
are  superimposed  in  the  right  column.  For  each  subject  the  latency  of  1 he  "visual 
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P300"  was  much  longer  than  that  of  the  "auditory  P300"  (t  = 10.91,  p < 0.001).  The 
mean  peak  latency  of  the  auditory  P300  was  360  msec  and  the  mean  peak  latency  of  the 
visual  P300  was  500  msec.  The  two  coroonents,  however,  exhibited  similar  scalp- 
amplitude  distributions.  Table  1 (a  and  b)  gives  the  mean  P300  amplitudes  at  each 
electrode  site  for  the  auditory  and  visual  ERPs.  The  peak  of  the  P300  component  was 


INSERT  TABLE  1 ABOUT  HERE 


chosen  as  the  largest  positive  deflection  within  a latency  range  chosen  by  visual 
inspection  of  each  ERP  waveform  and  its  amplitude  was  measured  relative  to  the  100  msec 
pre-stimulus  baseline.  The  auditory  P300  was  of  somewhat  smaller  amplitude  than  the 
visual  P300  but  for  both  modalities  the  largest  P300  amplitudes  were  recorded  at  the 
parietal  electrode,  decreasing  rapidly  posteriorly  and  more  slowly  frontally.  The 
variation  in  amplitude  across  electrode  sites  was  statistically  significant  (F(4,20)  = 
12.19,  p < 0.01),  while  the  effect  of  modality  was  noL  significant  (F(l,5)  = 3.28)  due 
to  the  U-shaped  nature  of  the  scalp  distribution;  the  interaction  of  electrode  site 
and  modality  was  significant  (F(4,20)  = 6.25,  p < 0.01) . 

P300s  to  bimodal  stimuli.  When  an  unchanging  stimulus  in  a second  modality  was 
presented  simultaneously  with  the  Bernoulli  sequence  in  the  first  modality  (conditions 
5 and  6)  the  rare  stimulus  evoked  a P300  component  that  closely  resembled  the  P300 

by  that  stimulus  presented  alone.  The  left  column  of  Figure  2 presents  the 
superimposed  tracings  of  ERPs  elicited  by  the  rare  auditory  stimulus  when  presented 
alone  (solid  line)  and  when  accompanied  by  the  frequent  (unchanging)  visual  stimulus 
(dashed  line).  The  analogous  data  for  the  visual  ERPs  are  shown  on  the  right.  There 
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were  no  statistically  significant  differences  in  amplitude  or  latency  of  P300  due  to 
the  addition  of  an  unchanging,  irrelevant,  stimulus  in  the  other  modality.  The  scalp 
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distributions  of  P300  amplitude  also  remained  unchanged  (Table  1,  c,  d) , maintaining 
a parietal  maximum. 

When  rare  stimuli  occurred  simultaneously  in  the  two  modalities  (condition  7), 
the  P300  mirrored  the  P300  elicited  by  the  auditory  element  alone  (condition  5).  This 
is  demonstrated  in  Figure  3 where  the  ERPs  to  the  "rare  auditory  - frequent  visual" 
combinations  are  compared  with  those  to  the  "rare  auditory  - rare  visual"  combinations. 
There  were  no  statistically  significant  differences  in  amplitude  or  latency  of  the 
P300s  thus  compared  The  similarity  of  these  waveforms  suggests  that  the  rare  visual 
stimulus  was  not  contributing  to  the  P300  in  condition  7. 

INSERT  FIGURE  3 ABOUT  HERE 


DISCUSSION 

Apparently  the  contributions  of  the  two  modalities  to  the  bisensory  P300  can  be 
readily  determined.  The  auditory  and  visual  P300s  differed  in  latency  by  140  msec, 
and  when  the  two  series  were  redundantly  combined,  the  resulting  P300  occurred  at  the 
latency  of  the  auditory  P300  and  showed  no  effect  (on  latency  or  waveshape)  of  the 
visual  stimulus.  Choice  reaction  times  in  analogous  situations  behave  in  much  the 
same  way;  when  the  choice  reaction  times  to  stimuli  in  each  modality  are  widely 
disparate,  the  reaction  time  to  the  redundant  bimodal  stimulus  equals  that  of  the 
shorter  unimodal  RT  (e.g.,  Hershenson,  1962;  and  see  Loveless,  Brebner,  and  Hamilton, 
1970,  for  a review  of  bisensory  stimulation). 

The  predominance  of  the  auditory  P300  might  be  attributed  to  a natural  auditory 
predominance  deriving  from  some  inherent  difference  in  the  processing  of  auditory  and 
visual  stimuli.  This  interpretation  is  unlikely,  however,  In  view  of  the  data  of 
Colavita  (1974)  showing  a pronounced  visual  predominance  in  a reaction  time  task  with 
somewhat  different  auditory  and  visual  stimuli  than  were  used  here.  Alternatively, 
the  discrimination  between  the  1000  Hz  tone  and  the  1500  Hz  tone  might  have  been  easier 
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than  the  discrimination  between  the  right-pointing  and  left-pointing  arrows,  and  the 

P300  associated  with  the  easier  task  might  predominate.  The  next  experiment  addressed 
this  issue. 


EXPERIMENT  II  - INTRODUCTION 

A reasonable  interpretation  of  the  data  of  Experiment  I is  that  P300  latency  re- 
flects the  latency  of  the  decision  about  the  stimulus.  It  has  been  previously  demon- 
strated in  choice  RT  experiments  (e.g.,  Biederman  and  Checkosky,  1970;  Felfoldy,  1974; 
Thurmond  and  Alluisi,  1963)  that  decision  latency  varies  with  stimulus  discriminability . 
Furthermore,  the  degree  of  facilitation  of  the  bisensory  RT  depends  upon  the  similarity 
of  the  RTs  to  the  two  component  stimuli.  In  situations  like  the  one  in  Experiment  I 
where  the  individual  RTs  are  quite  different,  no  bisensory  interaction  is  found,  but 
faith  similar  component  RTs,  the  RT  to  the  compound  is  shorter  than  either  of  the  uni- 
modal  RTs  (c.g.,  Biederman  and  Cueckosky,  1970;  Wood,  1974).  Experiment  II  therefore 
varied  intramodality  discriminability  to  determine  whether  the  auditory  predominance 
of  Experiment  I was  reversible,  and  whether  bisensory  facilitation  is  reflected  in 
Plff. 

METHODS 

Subjects.  Six  subjects  (5  female  and  1 male)  participated  in  the  ERP  section  of 
this  experiment,  including  three  subjects  from  the  previous  experiment.  (Subjects  1, 

2,  and  6 of  that  experiment  are  subjects  1,  2,  and  4 here).  Seven  subjects  (including 
1 and  2)  participated  in  the  RT  segment. 

Stimuli.  Two  sets  of  auditory  stimuli  were  used,  1100  Hz  vs  1^00  nz  tones  (the 
easy  auditory  discrimination)  and  1100  Hz  vs  1060  Hz  tones  (the  difficult  auditory 
discrimination),  with  the  1100  Hz  tone  the  rare  (P  = 0.10)  stimulus  in  both  cases. 
Similarly,  there  were  two  sets  of  visual  stimuli,  orange  vs  blue  (the  easy  visual 

discrimination)  and  orange;  vs  yellow  (the  difficult  visual  discrimination),  with 
orange  the  rare  stimulus  in  both  cases.  The  color  stimuli  were  produced  by  filtering 
the  tachistoscope  flashes  with  opaque-projector  filters  of  various  hues. 
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The  stimulus  durations  and  repetition  rates  in  the  ERP  experiment  were  the  same 
as  in  Experiment  I.  In  the  RT  experiment  each  stimulus  presentation  followed  the 
previous  response  after  a random  interval  of  500-1000  msec. 

Procedures . There  were  eight  conditions  in  this  experiment.  Four  involved  uni- 
modal  stimuli  and  four  involved  bimodal  stimuli.  The  four  uiimodal  stimulus  conditions 
were  the  easy  auditory,  difficult  auditory,  easy  visual,  and  difficult  visual  discrim- 
inations. In  the  bimodal  stimulus  conditions  each  auditory  discrimination  was  paired 
with  each  visual  discrimination,  with  the  rare  events  in  each  modality  occurring 
simultaneously  as  in  the  previous  experiment . 

During  ERP  recording  trials  were  presented  in  blocks  of  150,  with  the  instruction 
lo  count  the  rare  stimuli.  Each  of  the  eight  conditions  was  presented  three  times 

during  the  course  of  two  two-hour  testing  sessions  with  the  order  of  presentation 
balanced . 

During  the  reaction-time  sessions,  one  cf  two  buttons  was  pressed  depending  upon 
the  stimulus  presented.  Stimuli  appeared  iri  blocks  of  100.  The  RTs  reported  here 
are  the  means  of  two  blocks  of  trials,  one  in  which  the  subjects  responded  with  the 
left  hand  to  rare  stimuli  and  the  right  hand  to  frequent  stimuli,  and  one  in  which 
the  association  of  hands  and  stimuli  was  reversed.  While  it  would  have  been  obviously 
advantageous  to  record  the  RTs  at  the  same  time  the  ERPs  were  recorded  (Donchin  and 
Sutton,  1970)  the  likelihood  that  motor  potentials  (Kornhuber  and  Deecke,  1965)  would 
contaminate  the  P300  argued  for  separate  acquisition  of  these  data.  Also  the  reaction- 
time data  were  collected  primarily  to  validate  any  bisensory  interactions  obtained  here 
by  comparing  them  with  previous  reports,  and  net  to  make  direct  P300  - RT  comparisons. 

RESULTS 

RT_da_ta.  Mean  reaction  times  to  the  rare  and  frequent  stimuli  are  shown  in 
Table  2.  The  easy  discriminations  in  the  two  modalities  yielded  virtually  identical 
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Rls.  The  RTs  for  the  difficult  discriminations  were  considerably  longer.  These 
data  replicate  previous  findings  on  discr iminability  and  RT  (e.g.,  Thurmond  and 

Ailiusi,  1963).  The  bimodal  stimuli  whose  elements  gave  widely  dilferent  RTs  (easy 
auditory  - difficult  visual  and  difficult  auditory  - easy  visual)  yielded  RTs  that 
were  significantly  less  than  the  longer  of  the  two  unimodal  RTs  (p  < 0.05  for  each 

comparison;  and  approximately  equalled  the  earlier  of  the  two  unimodal  RTs.  This  was 
true  for  both  the  rare  and  frequent  stimuli  in  each  case.  When  the  RTs  to  both  elements 
of  the  compound  were  more  similar  (easy  auditory  - easy  visual  and  difficult  auditory  - 

difficult  visual),  the  mean  RTs  to  the  bimodal  stimuli  were  shorter  than  either  of  the 
unimodal  RTs.  This  result  was  statistically  significant  for  the  bimodal  difficult 
condition  (F(2,12)  = 10.91,  p < 0.01),  but  not  for  the  bimodal  easy  condition  (F(2,12)  = 
3.58,  p < 0.10) . 

P300  latency.  The  latency  data  for  the  P300  at  the  vertex  electrode  are  given  in 
Table  3.  (The  vertex  electrode  was  used  for  reasons  thrtt  will  be  discussed  below.) 

In  general,  the  relationships  among  the  P300  latencies  in  the  various  conditions 

INSERT  TABLE  3 ABOUT  HERE 

parallel  the  relationships  between  the  RTs  described  above,  with  shorter  P300  laten- 
cies corresponding  to  faster  reaction  times.  The  main  exception  to  this  is  the 
difficult  auditory  condition,  where  the  RTs  were  long  compared  to  the  difficult  visual 
condition,  while  the  PHHT  latencies  in  the  difficult  auditory  and  difficult  visual 
conditions  were  almost  equal.  Since  the  data  were  collected  with  different  groups  of 
subjects  no  clear  interpretation  can  be  made  of  this  discrepancy. 

P300  amplitude  and  scalp  distribution.  The  scalp  distributions  of  the  P300s  are 
shown  in  Figure  4.  All  the  P300  distributions  are  similar,  with  maximum  amplitude  at 
Pz.  The  bimodal  P300s  tended  to  be  somewhat  larger  than  the  unimodal  P300s. 
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Slow-wave  amplitude  and  scalp  distribution.  The  "slow-wave"  is  another  com- 


ponent that  has  been  identified  in  the  ERP  to  unexpected  target  stimuli  (Squires,  K. , 
Donchin,  Herning,  and  McCarthy,  in  press;  Squires,  N.,  et  al.,  1975).  Slow-wave 

amplitude  was  measured  as  the  mean  base-to-peak  amplitude  over  the  last  150  msec  of 
each  waveform,  and  these  data  are  shown  in  Table  4.  In  agreement  with  earlier  studies, 
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the  slow-wave  is  positive  at  the  parietal  electrode  and  negative  frontally.  In  addi- 
tion, the  present  experiment  provided  data  on  the  slow-wave  at  Oz  and  FPz  where  it  is 
positive  and  negative  respectively.  The  slow-wave  distribution  and  amplitude  were 
unaffected  by  stimulus  modality,  task  difficulty,  and  the  bimodal  vs  unimodal  nature 
of  the  eliciting  stimulus.  The  slow-wave  has  its  lowest  absolute  amplitude  at  the 
vertex;  thus  to  the  extent  that  P300  and  slow-wave  overlap  temporally,  the  amount  of 
contamination  of  base-to-peak  measures  of  P300  by  the  slow-wave  is  minimal  at  this 
site.  For  this  reason  all  between-condition  comparisons  of  P300  latency  and  amplitude 
in  the  present  experiments  were  made  at  Cz. 

DISCUSSION 

Experiment  I raised  the  question  of  whether  the  predominance  of  the  auditory  ele- 
ment of  the  bisensory  stimulus  was  due  to  differences  in  the  discriminability  of 
stimuli  within  each  modality  or  whether  the  visual  modality  always  plays  a subordinate 
role  in  the  elicitation  of  the  bisensory  P300 , The  results  of  Experiment  II  indicate 
that  the  discriminability  of  the  stimuli  within  the  modality  is  the  factor  determining 
which  modality  will  predominate.  While  the  auditory  element  predominated  in  the  easy 
auditory  - difficult  visual  condition,  the  opposite  was  true  for  the  difficult  audi- 
tory - easy  visual  condition.  P300  appears  to  be  dominated  by  whichever  modality  is 
associated  with  the  earlier  decision  (as  inferred  from  P300  latency  and  RT) . When  the 
decisions  in  the  two  modalities  have  approximately  the  same  latencies,  the  bisensory 
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J-300  is  earlier  chan  either  individual  P300.  These  resuits  are  in  agreement  with 
the  RT  literature,  where  it  has  been  suggested  (e.g.,  unless,  Brehner,  and  Hamilton, 

197°;  RMb-  I962>  W°°d'  1975>  that  »"-»■*  sains  tan  be  explained  by  a statistieal 
combination  model  that  assumes  that  processing  of  component  dimensions  precedes  simul- 
taneously «„  parallel)  and  that  the  RT  on  each  trial  is  determined  by  whichever 
component  process  is  completed  first.  The  amount  of  redundancy  gain  win  bc  propor- 
tional to  the  overlap  of  the  unimodal  RT  distributions.  When  such  gains  occur,  the 
variance  of  the  distribution  of  the  blmodal  RTs  should  also  be  reduced  compared  to 
the  unimodal  RT  distributions.  Assuming  that  P300  latency  is  correlated  with  the 
decision  latency,  this  RT  model  p,  diet,  a decrease  in  the  latency  of  P^O  and  an  in- 
crease in  its  amplitude  due  to  the  decreased  variability  in  the  timing  of  the  decision. 
Experiment  II  showed  that  the  decreased  latencies  of  the  bimodal  P300s  were  indeed 
associated  with  increased  P300  amplitudes.  (A  similar  prediction  would  of  course  be 
made  by  any  model  that  accounted  for  decreased  RT  variance  with  decreased  RT.) 

One  particularly  important  aspect  of  these  data  is  the  marked  effect  that  stimulus 
dlseriminability  had  on  the  latency  of  the  P300.  The  latency  of  the  P300  to  the 
1100  Hz  tone,  for  example,  was  60  msec  later  when  paired  with  a 1060  Hz  tone  than 
when  paired  with  a 1000  Hz  tone,  even  though  in  both  conditions  the  counting  perfor- 
mance was  nearly  perfect.  While  we  have  implicated  the  role  of  task  "difficulty"  by 
our  use  of  the  labels  "easy"  and  "difficult,"  explanations  in  terms  of  the  salience  of 
the  target  stimulus  (Jenness,  1972),  or  the  magnitude  of  the  tempiate  mismatch  (Squires, 
Hillyard,  and  Undsay,  1973),  and  so  forth  may  be  equally  suitable.  It  was  not  the 
purpose  of  the  present  experiments  to  test  the  adequacy  of  various  exi  ting  hypotheses 
regarding  the^psychological  correlates  of  the  P300.  The  point  here  is  that  the  sensi- 
tivity of  P300  ictency  implies  considerable  variability  across  experiments  and  across 
subjects  due  to  differences  in  the  stimuli  used  and  the  difficulty  of  the  task  for  the 
individual  subject.  The  equivalence  of  late  positive  waves  of  varying  latencies  has 
sometime^been  questioned.  For  example,  Thatcher  (in  press)  has  suggested  that  a P300 
and  a P400  may  be  different  components  even  though  they  are  recorded  under  similar 
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circumstances.  Our  data  suggest,  as  do  others1  (Kui-e,  and  Donchin,  in  press;  Ritter 
et  al.,  1972),  that  the  latency  of  the  late  positive  component  is  determined  by  the 
latency  o.:  the  duration  of  the  endogenous  process  it  manifests  (Donchin,  1975).  A 
great  deal  of  caution  must  therefore  be  used  in  identifying  late  components  solely  on 
the  basis  of  peak  latency.  On  the  other  hand,  this  same  result  provides  encouraging 
evidence  that  P300  latency  is  indeed  a sensitive  measure  of  decision  processes  in  its 

own  right  although  in  the  past  the  major  emphasis  has  been  placed  instead  on  P300 
amplitude  variations. 

While  small  differences  in  the  scalp-amplitude  distributions  of  the  auditory  and 
visual  P300s  were  found  in  the  first  experiment,  no  such  differences  were  found  in 
Experiment  II  when  the  discriminability  of  the  stimuli  within  the  two  modalities  were 
equated.  Thus  it  appears  that  the  auditory  and  visual  P300s  can  be  considered  to  be 
equivalent  components,  provided  that  the  conditions  under  which  the  auditory  and  visual 
P300s  are  elicited  have  been  carefully  equated. 


EXPERIMENT  III  - INTRODUCTION 

In  the  first  two  experiments  the  two  modalities  always  provided  redundant  infor- 
mation so  that  the  appropriate  response  was  always  perfectly  correlated  with  the 
stimulus.  For  a complete  assessment  of  the  degree  to  which  P300  reflects  the  inter- 
actions known  to  occur  between  multiple  channels  of  information,  it  is  necessary  also 
to  examine  the  effects  of  non-redundant  information.  When  subjects  are  asked  to  attend 
to  only  one  of  two  orthogonally  varying  dimensions  and  ignore  the  other,  the  task  is 
called  a filtering  task  (Posner,  1964).  Here  stimulus  changes  occur  with  and  without 
a change  in  response.  Felfoldy  (1974)  measured  reaction  times  in  a filtering  task  and 
demonstrated  that  both  stimulus  and  response  variables  influence  the  total  RT.  Experi- 
ment I1 I looked  at  whether  this  is  also  true  of  P300  latency. 

An  analysis  of  filtering  tasks,  however,  must  take  into  account  the  nature  of 
the  stimulus  dimensions  used.  Garner  (1974)  classified  pairs  of  dimensions  as  "integral1 
.separable.  For  visual  stimuli,  for  example,  value  and  chroma  are  integral 
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dimensions,  while  size  and  lightness  are  separable,  perceptually  independent  dimen- 
sions. Several  converging  operations  have  been  used  to  support  this  distinction  in- 
cluding similarity  judgements,  perceptual  classification  tasks,  reaction  time,  and 
speeded  classification  (card  sorting)  tasks  (Garner,  1974).  With  speed  measures  of 
performance,  redundant  integral  dimensions  facilitate  performance  but  redundant  separ- 
able dimensions  do  not  (Carner  and  Felfoldy,  1970;  Wood,  1974).  With  non-redundant 
dimensions,  on  the  other  hand,  filtering  tasks  are  completed  faster  with  separable  than 
with  integral  dimensions  (Gottwald  and  Garner,  1975).  While  one  might  expect  auditory 
and  visual  dimensions  to  be  independent  or  separable  (see  Garner,  1974,  p.  170),  both 
the  P300  latency  and  RT  data  of  Experiment  II  meet  the  fir-  criterion  for  integrality: 
facilitation  under  conditions  of  redundant  information.  However,  as  Garner  has 
pointed  out  (p.  132),  in  circumstances  such  as  those  in  Experiment  II  it  is  to  the 
subject's  advantage  to  attend  to  both  dimensions  even  when  they  are  by  nature  separable. 
A more  critical  test  of  the  integrality  or  separability  of  dimensions  comes  from  pro- 
cedures where  the  information  provided  by  the  two  dimensions  is  not  redundant,  and 
attention  to  both  dimensions  would  interfere  with  performance.  If  the  subject  cannot 
exclude  the  irrelevant  dimension  the  dimensions  are  integral;  if  no  interference  is 
found  the  dimensions  are  separable.  Experiment  III  therefore  investigated  P300  and 
RT  measures  of  information  processing  with  the  elements  of  the  bisensory  stimuli  pro- 
viding non-redundant  information. 


METHODS 

Subjects.  Five  subjects  (4  female  and  1 male)  participated  in  the  ERP  section  of 
Experiment  III,  including  two  (subjects  1 and  2)  who  had  participated  in  both  previous 
experiments.  RTs  were  taken  from  the  same  seven  subjects  who  participated  in  the  RT 
section  of  Experiment  II. 

_Stimuli.  All  stimuli  in  this  experiment  were  bisensory,  audio-visual  compounds. 
The  two  auditory  stimuli  were  a 1000  Hz  tone  and  an  1100  Hz  tone,  the  "easy  auditory" 
discrimination  of  the  last  experiment.  The  two  visual  stimuli  were  an  orange 
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flash  and  a blue  flash,  the  easy  visual"  discrimination.  Four  types  of  bisensory 
stimuli  could  occur  in  each  block  of  trials:  1000  Hz  - orange  (P  = 0.85),  1000  Hz  - 

blue  (?  =■  0.05),  1100  Hz  - orange  (P  = 0.05),  and  1100  Hz  - Hue  (P  = 0.05).  Thus 
there  were  three  equi-probable  types  of  rare  stimuli,  two  of  which  had  a rare  stimulus 
in  one  modality  and  one  with  rare  stimuli  in  both  modalities.  The  stimuli  were  the 
same  on  every  block  of  trials;  only  the  task  differed. 

Procedure.  The  subject  was  assigned  one  of  three  tasks  at  the  beginning  of  a 
block  of  trials:  1)  count  all  rare  (1100  Hz)  tones,  2)  count  all  rare  (blue)  flashes, 
or  3)  count  both  rare  tones  and  rare  flashes,  coun i 1 ug  a double  rare  as  one.  There 
were  150  stimuli  per  block,  and  five  blocks  were  presented  in  each  counting  conditio.! 
in  counterbalanced  order  over  the  course  of  two  two-hour  sessions.  In  addition,  three 
control  conditions  ware  presented  in  which  each  of  the  combinations  o 1 auditory  and 
visual  stimuli  was  the  frequent,  non-counted  stimulus,  with  the  exception  of  1000  Hz  - 
orange  which  had  been  the  frequent  stimulus  in  all  orv„r  blocks.  Reaction  Limes  were 
collected  in  the  same  manner  as  in  the  previous  experiment. 

RESULTS 

Waveforms.  The  ERPs  for  two  subjects  are  shown  in  Figure  5.  The  data  of  chese 
subjects  were  chosen  as  the  most  representative  of  the  experimental  effects.  Each 
waveform  is  the  difference  between  the  averaged  ERP  to  a particular  rare  compound  and 
the  corresponding  ERP  to  that  compound  when  it  was  frequent.  These  subtractions  were 
made  in  order  to  show  the  isolated  effects  of  the  various  rare  events,  without  any 

stimulus-specif ic  effects.  The  solid  lines  are  the  waveforms  associated  with  the 
double-rare  stimulus;  this  same  waveform  is  shown  tw:'ce,once  on  the  left  superimposed 

INSERT  FIGURE  5 ABOUT  HERE 

on  the  ERP  to  the  auditory  rare  - visual  frequent,  and  once  on  the  right  with  the  ERP 
to  the  auditory  frequent  - visual  rare.  The  three  counting  conditions  are  represented 


in  the  three  rows.  The  amplitude  and  latency  of  the  double-rare  PjTOU-  remainr < 
approximately  the  same  across  counting  conditions,  while  the  amplitudes  of  the  single- 
rare  P300s  varied  with  the  instructions. 

P3Q0  amplitude  and  latency.  The  latencies  of  the  P300s  to  the  double-rare 
stimali  and  to  the  auditory  rare  (visual  frequent)  stimulus  were  about  the  same,  350- 
355  msec  in  every  counting  condition  (Table  5).  The  latency  of  the  visual  rare 
(auditory  frequent)  P300  was  40-50  msec  longer.  These  latencies  were  all  unaffected 
by  the  counting  task. 


INSERT  TABLE  5 ABOUT  HERE 


The  amplitude  of  the  P3()f'  io  the  double-rare  stimulus  was  consistently  greater 
than  that  of  either  single-rare  PTUU"  and  was  u affected  by  the  counting  condition. 

For  the  single— rare  f 300s  the  maximum  amplitude  occurred  when  only  rares  in  that 
modality  were  being  counted,  minimal  vhen  stimuli  in  the  other  modality  were  counted, 
arl  intermediate  when  both  were  counted. 

Reaction  times.  The  mean  reaction  times  to  all  four  stimuli  in  each  of  the  three 
conditions  are  shown  in  Table  6.  RTs  to  rare  stimuli  in  the  task-relevant  modality 
combined  with  a frequent  in  the  irrelevant  modality  were  much  longer  than  those  to  the 

INSERT  TABLE  6 ABOUT  HERE 


double-frequent  stimuli,  for  both  auditory  and  visual  modalities  (a  difference  of  128 
msec  for  the  auditory  in  the  "attend-auditory"  condition,  p < 0.001,  and  123  msec  for 
the  visual  in  the  "attend-visuai"  condition,  p < 0.0C1).  A rare  stimulus  in  the 
irrelevant  modality  also  lengthened  t ne  reaction  time,  but  by  a smaller  amount  (42  msec 
for  irrelevant  visual  in  the  attend-auditory  condition,  p < 0.05,  and  66  msec  for  the 
irrelevant  auditory  in  the  attend-visuai  condition,  p < 0.01).  The  RT  to  the  double- 
rare  stimulus  was  significantly  shorter  than  to  the  single  auditory  rare  in  the  audi- 
tory condition  (25  msec,  p < 0.01),  but  not  significantly  shorter  in  the  attend  visual 
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condition  (15  msec).  When  subjects  were  instructed  to  attend  to  both  modalities 
the  RTs  to  all  stimuli  were  lengthened  over  the  single-modality  conditions.  (E.g., 
the  mean  RT  for  double-frequent  stimuli  in  the  attend-both  condition  was  19  msec 
longer  tr.  n in  the  attend-auditory  condition  and  41  msec  longer  than  in  attend- 
visual.) 

P300  scalp  distribution.  The  scalp-amplitude  distributions  of  P300  are  given  in 
Figure  6 for  each  of  the  three  types  of  rare  stimuli.  The  P300  to  the  auditory  fre- 
quent - visual  rare  (bottom  frame)  had  a parietal  maximum  and  resembled  the  distribu- 
tion in  the  "easy-visual"  task  of  Experiment  II.  However,  the  distributions  for  the 
auditory  rare  - visual  frequent  (middle  frame)  and  the  double-rare  P300  (top  frame) 
were  more  equipotential  than  those  shown  before  (Figure  4) . The  mean  ratios  of  Fz  to 


INSERT  FIGURE  6 ABOUT  HERE 

to  Pz  were  0.96,  0.93,  and  0.42  for  the  double-rare,  the  auditory-rare,  and  visual- 
rare  P300s  respectively.  An  analysis  of  variance  on  the  base-to-peak  amplitudes  of  the 
auditory  and  visual  P300s  showed  a significant  interaction  between  the  effects  of 
stimulus  and  electrode  position  (p  < 0.01,  F(4,16)  = 4.82)  while  a similar  analysis  of 
the  P3008  to  the  same  stimuli  in  Experiment  II  gave  a non-significant  interaction 
(F(4,20)  » 0.11).  This  comparison  is  particularly  meaningful  in  view  of  the  fact  that 
the  topographical  differences  in  Experiment  III  were  found  within  the  sat.  ;eries  of 
stimulus  presentations,  while  the  identical  disti ibutions  in  Experiment  II  represent 
comparisons  across  blocks  of  trials. 

Slow  wave.  The  slow  wave  was  measured,  as  before,  as  the  mean  difference  in 
voltage  from  the  pre-stimulus  baseline  to  the  last  150  msec  of  each  waveform.  These 
values  are  shown  in  Table  7.  While  the  amplitudes  and  amplitude  variations  across 
electrodes  differ  somewhat  across  conditions,  particularly  for  t^e  auditory  frequent- 
visual  rare  stimulus,  the  variations  are  unsystematic  and  do  not  correlate  with  the 


distributional  variations  of  the  P300.  Thus  the  distributional  differences  found  for 
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the  auditory  and  visual  P300,  cannot  be  attributed  to  variations  in  the  slow  wave 
elicited  by  the  different  stimuli.  The  distributional  differences  can  be  accounted 
for  by  the  differential  overlap  of  slow  wave  with  the  early  and  late  PlOOs.  Subjects 
with  large  slow  waves  and  large  latency  differences  between  auditory  and  visual  P300s 
also  showed  large  distributional  differences.  Those  with  small  slow  waves  and  small 
latency  differences  had  little  or  no  distributional  difference.  The  size  of  the 
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distributional  difference  between  the  auditory  and  visual  P300s  (auditory  Fz/Pz  ratio 
minus  the  visual  Fz/Pz  ratio)  had  a 0.75  correlation  with  the  size  of  the  slow  wave 
across  the  five  subjects,  and  a correlation  of  0.86  with  the  difference  in  the  peak 
latencies  of  the  auditory  and  visual  P300s. 

DISCUSSION 

For  a simplified  comparison  of  the  present  data  with  traditional  measures  of  bi- 
sensory  interaction  RTs  to  all  stimuli  in  a condition  were  averaged  for  the  relevant 
conditions  of  Experiment  II  and  III  (Table  3).  ds  discussed  previously.  Experiment  II 
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showed  a gain  in  performance  with  redundant  dimensions  (cf.  cols.  1 and  11).  In  Experl 
ment  III  dimensional  interference  was  found  in  the  filtering  tacxs  (compare  column  ill, 
"filtering,"  with  the  corresponding  unioodal  results).  Even  greater  interference  was 
found  in  the  condensation  task  (col.  iii).  While  these  effects  are  not  large,  they  are 
corn-arable  to  the  effects  previously  reported  (e.g.,  Felfoldy,  1974;  Garner,  1974). 2 
Furthermore,  interference  between  the  dimensions  in  Experiment  111  can  also  be  Inferred 
from  an  analysis  of  the  RTs  to  the  individual  types  of  rare  events  (Table  6) . Irrele- 
vant rare  events  delayed  the  "fluent"  response  and  facilitated  the  "rare"  response. 
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confirming  that  the  irrelevant  dimension  was  in  fact  not  ignored.  The  ERP  data 
also  support  this  conclusion  since  the  irrelevant  rare  stimuli  did  elicit  a small 
P300.  By  Garner’s  criteria  then,  the  pitch  and  color  dimensions  used  in  these  experi- 
ments would  be  considered  "integral"  dimensions.  That  this  is  the  case  with  dimen- 
sions in  two  different  sensory  modalities  is  perhaps  surprising.  One  possibility  is 
that  with  further  training  the  subjects  might  have  been  able  to  separate  the  dimensions 
more  completely;  however,  the  data  of  the  two  subjects  who  had  already  participated 
xn  the  previous  two  experiments  indicate  that  this  is  unlikely.  Another  important 
factor  might  be  the  difficulty  of  the  discriminations  involved;  according  to  Long 
(1975),  who  used  auditory  frequency  aid  visual  intensity  dimensions,  interference 


is  observed  when  the  intra-modality  discriminations  are  difficult,  but  no  interference 
is  observed  with  easy  discriminations.3  A third  possibility  is  that  a. ternating  be- 
tween tasks,  as  was  done  here,  interferes  with  the  subjects'  separation  of  the  modali- 
ties. Whatever  the  explanation,  it  appears  that  the  integrality  concept  must  be 
interpreted  more  broadly  than  it  has  been  previously.  The  close  agreement  found  here 
between  the  physiological  and  performance  data  nevertheless  supports  the  distinctions 
Garner  has  made  about  stimulus  dimensions  and  also  the  utility  of  the  P300  component 
of  the  evoked  response  as  a measure  of  these  variables. 


The  RT  data  of  Experiment  III  agree  with  those  of  Felfoldy  (1974);  the  shortest 
RTs  were  to  the  double-frequent  stimuli;  a "rare"  stimulus  that  required  a "frequent- 
response  (i.e.,  an  irrelevant  rare)  produced  some  delay  in  RT,  while  a "rare"  stimulus 
requiring  a "rare"  response  (a  relevant  rare)  delayed  the  response  even  further.4  The 
RT  data,  with  those  of  Felfoldy,  support  the  idea  that  reaction  time  reflects  at 
least  two  stages  of  processing,  evaluation  of  tht  stimulus  and  initiation  of  the 
appropriate  motor  response.  On  the  other  hand,  the  latency  of  P300  did  not  vary  with 
the  counting  response  required.  It  is  clear  from  Experiments  1 and  II  that  P300 
latency  can  vary  widely  in  counting  tasks.  There,  P300  latency  varied  with  the 
dis 'riminability  of  the  relevant  stimuli;  the  more  difficult  it  was  to  identify  the 


85< 


21 


stimuli,  the  later  was  the  P300.  In  Experiment  III  the  discriminability  of  the  two 
stimuli  was  constant,  and  so  was  the  P300  latency.  So  while  there  are  evident  differ- 
ences between  reaction  time  and  counting  tasks,  the  data  of  Experiments  II  and  III, 
when  taken  together,  present  an  instance  in  whicl  an  independent  variable  (stimulus 
discr iminality)  affects  both  P300  latency  and  RT  and  another  instance  in  which  an 
independent  variable  (choice  of  target  stimulus)  affects  reaction  time  and  P300  ampli- 
tude, but  has  no  effect  on  P300  latency.  A plausible  interpretation  of  these  data  is 
that  the  process  manifested  by  P300  is  involved  with  stimulus  evaluation  rather  than 
with  response  selection.  Acceptance  of  this  tentative  conclusion  must  be  tempered 
with  caution  pending  a more  direct  comparison  between  the  reaction  time  and  counting 
tasks.  A preliminary  comparison,  however,  has  been  reported  by  Kutas  and  Donchin  (in 
press),  and  their  results  are  consistent  with  the  present  view. 

The  amplitude  of  the  P300,  unlike  its  latency,  did  vary  with  the  task  in  Experi- 
ment III.  An  irrelevant  rare  stimulus  produced  a small  P300,  a rare  stimulus  in  the 
relevant  modality  evoked  a larger  P300,  and  the  largest  P300  was  associated  with  the 
double-rare  stimuli.  Thus  P300  amplitude  appears  to  increase  with  the  discrepancy 
between  the  stimulus  expected  (the  double-frequent)  and  that  which  actually  occuro. 

This  effect  has  been  called  "equivocation"  by  Ruchkin  and  Sutton  (in  press)  and  has 
been  supported  by  several  investigations  (e.g.,  Adams  and  Benson,  1973;  Ford,  Roth 

and  Kopell,  1976;  Hillyard,  Squires,  K. , and  Squires,  N.,  no^e  1;  Johnao r>  and  Dor-hin, 
note  2) . 


The  scalp  distribution  of  P300  varied  in  yet  a third  manner ; auditory  rare  and 
double-rare  stimuli  both  evoked  P300s  that  were  basicaVy  eqaipoteni ial  over  Pz,  C/., 
and  Fz,  while  the  P300s  to  the  visual-rare  stimuli  wu^e  lar,  r at  o*  than  Ft.  These 
relationships  were  independent  of  the  counting  condition.  This  resilt  is  of  particu- 
lar importance  in  view  of  the  recent  trend  in  the  P300  literature  to  identify  a variety 
of  different  kinds  of  "P300s"  mainly  on  the  basis  of  their  different  scalp  topographies 
(see  Tueting,  in  press,  for  a discussion  of  this  trend;.  While  we  have  tentative! v 
at  ributed  the  effect  reported  here  to  the  differ 


ential  overlap  of  P3CJ  and  sio<’  wave, 
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it  is  certainly  not  clear  at  this  point  whether  such  an  explanation  would  account 
for  other  reported  differences  in  scalp  topography,  for  example  those  of  Courchesne, 
Hillyard , and  Galambos  (1975)  who  reported  that  novel,  irrelevant  visual  stimuli  in- 
serted into  a Bernoulli  series  of  visual  stimuli  elicited  a P300  with  a frontal 

distribution,  while  the  relevant  rare  targets  elicited  a P300  with  a more  parietal 
distribution. 

Since  it  appears  that  speed  measures  of  information  processing  provide  a combined 
measure  of  several  stages  of  processing,  while  P300  is  influenced  by  only  a particular 
subset  of  those  variables,  P300  emerges  as  a useful  adjunct  to  more  traditional  means 
of  evaluating  cognitive  events.  This  is  particularly  true  in  that  P300  appears  to 
be  a multifaceted  index  whose  various  characteristics  are  functionally  independent. 

P300  latency  reflects  the  discriminability  of  stimuli  along  the  relevant  dimension  and 
presumably  the  speed  of  identification  and  decision  making  (Experiments  I and  II);  P300 
amplitude  increases  when  the  jitter  in  its  latency  is  reduced  (Experiment  II;  Ruchkin 
and  Sutton,  in  press)  and  with  increased  discrepancy  between  what  is  expected  and  what 
occurs  (Experiment  III);  and  finally  P300  sea  .p  distribution  also  varies  with  differ- 
ences in  processing,  although  the  nature  of  this  variation  is  as  yet  not  well  defined. 
While  the  functional  and  neurophysiological  nature  of  P300  and  other  ERP  components 
remain  to  be  determined,  the  experiments  reported  here  affirm  their  status  as 
important  indices  of  cognitive  processes,  and  perhaps  more  importantly  emphasize  the 
multifaceted  nature  of  P300  and  the  independence  of  its  various  characteristics. 
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Department  of  Defense  under  Contract  No.  DAHC-15  C 0318  and  the  US  San  Diego  State 
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A preliminary  version  of  this  report  was  presented  before  the  4th  Annual  Meeting  of 
the  Society  ror  Neuroscience,  N.  Y.,  1975.  (See  Neurosciences  Abstract,  Vol.  I,  1975, 

Abstract  #861) . 

2 

Also,  this  method  of  data  presentation  probably  underestimates  the  amount  of 
facilitation  or  interference  compared  to  more  traditional  measures  due  to  the  use  of 
asymmetric  probabilities  of  the  various  stimuli.  Felfoldy  (1974)  found  that  the 
largest  effect  of  going  from  one  variable  dimension  to  two  was  on  the  RTs  to  non- repe- 
titions of  stimuli.  In  that  the  use  of  asymmetric  probabilities  produces  fewer  non- 
repetitions, the  averaged  effect  would  be  diminished. 

O 

Long's  measure  of  interference  was  a decrease  in  the  percent  correct.  With  easy 
discriminations  performance  may  be  asymptotically  100%  correct,  and  interactions  be- 
tween the  dimensions  may  be  obscured.  Thus  the  relevance  of  this  variable  for  other 
types  of  measures  is  net  yet  clear. 

^Felfoldy  performed  a trial-by-trial  analysis  of  his  data,  looking  at  the  effects 
of  repetitions  and  non-repetitions  of  the  stimulus  and  response  conditions  from  the 
last  trial  Thus  the  analysis  is  not  directly  comparable  to  the  one  performed  here. 
However,  with  the  probabilities  used  in  Experiment  III,  it  can  be  safely  assumed  that 
the  "double-frequent'  stimuli  mainly  represent  repetitions  of  stimuli  and  resionses, 
and  that  the  rare  stimuli  represent  non-repetitions  of  stimuli,  and  either  repetitions 
or  notr- repetitions  of  reseponses,  depending  on  the  particular  condition,  so  that  by 
and  large  the  comparison  between  the  results  of  the  two  experiments  is  straightforward. 
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TABLE  1:  Scalp-amplituda  distributions  of  the  P300  component  associated 

with  rare  unimodal  and  bimodal  events  in  p volts.  Means  of  six 
subjects. 


Oz 

Pz 

Cz 

Fz 

FPz 

a) 

Auditory  rare 

12 

23 

21 

17 

5 

b) 

Visual  rare 

17 

34 

31 

14 

2 

c) 

Auditory  rare- 
visual  frequent 

17 

27 

22 

14 

1 

d) 

Visual  rare- 
Auditory  frequent 

16 

31 

25 

14 

3 

e) 

Auditory  rare- 
visual  rare 

18 

32 

26 

18 

4 

S4< 


30 


TABLE  2:  Reaction  times  to  rare  and 

frequent 

stimuli 

in  all  eight 

conditions 

of  E :periment  II.  Means  of 

seven  subjects. 

FREQUENT 

RARE 

Mean 

S.D. 

Mean 

S.D. 

Easy  Auditory 

279 

43 

387 

68 

Difficult  Auditory 

374 

66 

532 

101 

Easy  Visual 

276 

28 

392 

56 

Difficult  Visual 

340 

82 

446 

68 

Easy  Auditory-Easy  Visual 

251 

41 

366 

53 

Easy  Auditory-Difficult  Visual 

260 

32 

384 

67 

Difficult  Auditcry-Easy  Visual 

261 

32 

391 

56 

Difficult  Auditory-Difficult  Visual 

294 

34 

424 

66 

31 


TABLE  3:  Latencies  of  the  P300s  to  the  rare  stimulus  in  each  of  the  eight 

conditions  of  Experiment  II.  Means  of  six  subjects. 


P3G0  Latency 

Mean 

S.D. 

Easy  Auditory 

359 

41 

Difficult  Auditory 

419 

52 

Easy  Visual 

371 

18 

Difficult  Visual 

420 

16 

Easy  Auditory-Easy  Visual 

349 

35 

Easy  Auditory-Difficult  Visual 

362 

34 

Difficult  Auditory-Easy  Visual 

370 

16 

Difficult  Auditory-Difficult  Visual 

403 

34 

32 


TABLE  4 : Amplitude  (yv)  of  the  slow  wave  evoked  by  the  rare  stimulus  in 

ef ch  of  the  eight  conditions  of  Experiment  II,  for  the  five  elec 

trode  locations.  Mean  of  six  subjects. 


Condition: 

Auditory  Easy 
Auditory  Difficult 
Visual  Easy 
Visual  Difficult 

Auditory  Easy-Visual  Easy 
Auditory  Easy-Visual  Difficult 

Auditory  Difficult-Visual  Easy 
Auditory  Difficult-Visual  Difficult 


Electrode 


Oz 

Pz 

Cz 

Fz 

FPz 

9 

12 

1 

-14 

-17 

4 

9 

1 

- 8 

-12 

7 

10 

1 

-12 

-17 

3 

13 

5 

- 8 

-12 

4 

6 

-2 

-14 

-18 

6 

9 

-2 

-14 

-17 

3 

7 

-1 

-16 

-20 

9 

14 

5 

-13 

-14 

I 


S7< 
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TABLE  5:  Mean  P300  latencies  and  amplitudes  (Cz)  for  the  three  experimental 

conditions  for  the  three  types  of  rare  stimuli. 


P300  Latencies : 


STIMULUS 


Auditory  rare- 

Auditory  rare- 

Auditory  frequent- 

visual  rare 

visual  frequent 

visual  rare 

COUNT 

Mean: 

356 

354 

400 

AUDITORY 

S.D. 

(10) 

(lr) 

(23) 

COUNT 

Mean: 

350 

■56 

394 

VISUAL 

S.D. 

(20) 

(38) 

(23) 

COUNT 

Mean: 

352 

351 

398 

BOTH 

S.D. 

(17) 

(23) 

(23) 

P300  Amplitudes: 

COUNT 

Mean: 

25 

18 

5 

AUDITORY 

S.D. 

(10) 

(6) 

(3) 

COUNT 

Mean: 

23 

11 

13 

VISUAL 

S.D. 

(4) 

(2) 

(4) 

COUNT 

Mean : 

24 

14 

10 

BOTH 

S.D. 

(7) 

(4) 

(6) 

34 
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TABLE  6; 

wean  reaction 

times  to 

rare  and  frequent  stimuli 

for  the  seven 

subjects  in  Experiment 

III. 

AUDITORY: 

rare 

rare 

frequent 

frequent 

VISUAL: 

f requ  '.nt 

rare 

frequent 

ATTEND: 

AUDITORY: 

Mean 

401 

426 

340 

298 

S.D. 

67 

69 

80 

40 

VISUAL: 

Mean 

384 

342 

399 

276 

S.D. 

55 

62 

60 

24 

BOTH: 

Mean 

409 

485 

467 

317 

S.D. 

69 

90 

99 

42 

Table  7:  Amplitude  (yv)  of  the  slow  wave  evoked  by  each  of  the  three  types 

of  rare  ctimuli  in  each  experimental  condition  of  Experiment  III. 

Mean  of  five  subjects. 


Eliciting 

Stimulus: 

Counted 
Stimulus : 

Oz 

Electrode : 
Pz  Cz 

Fz 

FPz 

Auditory  rare- 

Auditory 

6.2 

5.9  0.0 

-5.4 

-6.5 

Visual  rare 

Visual 

4.5 

1.8  -3.5 

-9.0 

-7.7 

Both 

5.2 

2.8  -1.0 

-5.0 

-1.0 

Auditory  rare- 

Auditory 

■>.4 

3.4 

-2.8 

-7.8 

-11.2 

Visual  frequent 

Visual 

2.6 

2.6 

-0.2 

-4.8 

-7.1 

Both 

5.1 

6.2 

0.4 

-5.8 

-9.6 

Auditory  frequent- 

Auditory 

1.5 

4.5 

2.6 

-0.2 

-4.2 

Visual  rare 

Visual 

1.6 

2.7 

-5.1 

-12.3 

-13.4 

6.2  7.6 


2.0  -3.9  -8.8 


Both 


1G0< 
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TABLE  8:  Mean  RTs  in  unimodal  auditory  easy  and  visual  easy  conditions 

(Experiment  II),  the  redundant  compounds  (auditory  easy  - visual 
easy,  Experiment  II),  and  the  non-redundant  compounds  under 
different  instructional  conditions  (Experiment  III). 


STIMULI 


TASK 

i.  Unimodal 

ii.  Redundant 

iii . 

Non-Redundant 

AUDITORY 

290  (II) 

312 

(Ill-filtering) 

VISUAL 

288  (II) 

291 

(Ill-filtering) 

AUDITORY-VISUAL 

262  (II) 

338 

(Ill-condensation) 

■k 
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Figure  1 


Figure  2 


Figure  3 


Figure  4 


Figure  5 


Figure  6 
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FIGURE  LEGENDS 

: Experiment  1:  vertex  evoked  responses  to  the  unimodal  stimuli  for  each 
of  the  six  subjects.  The  responses  to  the  rare  stimuli  (solid  lines)  are 
super*  posed  on  the  responses  to  the  frequent  stimuli  (dotted  lines)  from 
the  same  condition. 

Each  subject's  vertex  evoked  responses  to  the  unimodal  auditory  and  visual 
rare  stimuli  (solid  lines)  superimposed  on  the  response  evoked  by  that  same 

stimulus  when  accompanied  by  a frequent  stimulus  in  the  other  modality. 

Vertex  evoked  responses  to  the  rare  auditory-rare  visual  compound  (solid 
line)  superimposed  on  the  response  to  the  rare  auditory-frequent  visual 
stimulus  (dotted  line)  for  each  of  the  six  subjects. 

Experiment  II:  Mean  baseline-to-peak  amplitude  of  P30P  at  each  of  the  five 

electrode  sites,  for  each  of  the  eight  experimental  conditions.  (Abbrevia- 
tions, auditory  easy  - AE,  auditory  difficult  - AD,  visual  easy  - VE, 
visual  difficult  - VD.) 

Experiment  III:  Subtracted  waveforms  of  two  subjects  for  double  (solid 

lines)  and  single  (dotted  lines)  rares  for  each  counting  condition.  The  ERP 
to  the  double  rare  (auditory  rare-visual  rare)  is  shown  once  in  the  left 

column  superimposed  on  the  response  to  the  auditory  rare-visual  frequent 
stimulus,  and  once  on  the  right  superimposed  on  the  response  to  the  visual 
rare-auditory  frequent  stimulus. 

Mean  P300  scalp-amplitude  distribution  for  each  stimulus  in  each  counting 


condition. 


P 300  AMPLITUDE  ( |JV  ) 
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Abstract 

In  each  of  two  experimental  conditions,  subjects  were  presented  with  a 
series  of  tones;  one  of  two  tones  (1500  Hz  or  1000  Hz)  wa s presented  on  each 
trial  with  a probability  respectively  of  .10  or  .90.  The  subjects  counted  the 
rare  (p  = .10)  tones;  such  counted  rare  tones  are  normally  associated  with  a 
large  P300  component. 

The  two  conditions  differed  in  tnat  in  one  the  tones  were  triggered  by 
the  subject's  button  press;  in  the  other  the  tones  were  triggered  by  computer. 
Schafer  & Marcus  (1973)  reported  that  all  the  components  of  event-related 
potentials  (ERPs)  elicited  by  self-triggered  tones  were  substantially  smaller 
than  those  elicited  by  machine-triggered  stimuli.  Our  paradigm  allowed  a detailed 
assessment  of  the  effects  of  self-stimulation  on  specific  ERP  components  as 
well  as  the  interaction  of  temporal  with  event  uncertainty. 

Data  were  analyzed  using  a Principal  Components  technique.  Both  temporal 
and  event  uncertainty  appeared  to  augment  a negative  component  of  the  ERP  with 
approximately  140  msec  latency.  Such  effects,  however,  were  confounded  by  the 
presence  of  slow  negative  potentials  preceding  the  button  press  in  the  self- 
stimulation conditions.  As  expected,  the  P300  component  was  largest  for  the 
ERPs  elioted  by  the  rare  tones.  Temporal  uncertainty  diminished  the  amplitude 
of  P3T5U  at  central  electrode  sites.  A large  slow  wave  was  present  following 
P300 ; its  anterior-posterior  distribution  was  altered  by  mode  of  stimulus 
presentation.  It  appears  that  temporal  and  event  uncertainty  have  distinct 
effects  upon  the  morphology  and  distribution  of  ERP  components. 


Descriptors:  P300 , auditory  evoked  potentials,  temporal  and  event  uncertainty. 
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Schafer  and  Marcus  (1973)  reported  differences  in  the  waveforms  of 
auditory  and  visual  event-related  potentials  (ERP)  as  a function  of  the  manner 
in  which  the  eliciting  stimuli  were  triggered.  Specifically,  the  ERPs 
elicited  by  subject-initiated  stimuli  were  considerably  smaller  (and  with 
shorter  latency  components)  than  ERPs  elicited  by  the  same  stimuli  triggered 
by  machine.  Schafer  and  Marcus  reported  that  all  components  of  the  ERP  whose 
latencies  exceed  100  msec,  including  the  P 300  component,  were  larger  in  the 
ERPs  elicited  by  the  machi ne -triggered  stimuli. 

The  two  modes  of  triggering  differ  in  at  least  two  ways:  (1)  a motor 

response  is  required  when  the  subject  triggers  each  stimulus,  and  (2)  the 
subject  cannot  know  with  certainty  when  the  machine-triggered  stimulus  will 
appear.  Schafer  and  Marcus  attribute  the  enhancement  of  the  ERP  components 
elicited  by  the  machine-triggered  stimuli  to  the  temporal  uncertainty.  Effects 
related  to  the  temporal  characteristics  of  stimulus  sequence:  have  been 
previously  reported  for  ERP  components  with  latencies  between  80  and  250 
msec  (Davis,  Mast,  Yoshie,  & Zerlin,  1966;  Rothman,  Davis,  & Hay,  1970; 

Lentonen,  1973).  However,  no  such  data  have  been  previously  reported  for  the 
P3O0  component. 

The  appearance  of  the  PTCKJ  component  in  the  averaged  ERP  has  been  linked 
to  stimulus  uncertainty  (Sutton,  Braren,  Zubin,  & Jonn,  1965;  Donchin,  1968). 

However,  in  such  studies  the  uncertainty  was  as  to  which  stimulus  would  occur 
(see  Donchin  & Cohen,  1967  for  an  exception).  In  the  Schafer  and  Marcus 
paradigm,  however,  the  stimulus  was  always  the  same,  in  question  was  its  time 
of  occurrence. 
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There  is  ample  evidence  that  the  task  relevance  or  information  value 
of  the  eliciting  stimulus  is  crucial  for  the  appearance  of  P300  (Donchin,1975). 
As  there  were  no  experimenter-directed  tasks  in  the  Schafer  and  Marcus  experi- 
ment, one  might  conclude  from  their  data  that  temporal  uncertainty  ie  sufficient 
for  the  elicitation  of  P3150.  Such  an  interpretation  gains  support  from  Ford, 
Roth,  & Kopell  (1976)  who  suggested  that  "the  well  known  influence  of  stimulus 
uncertainty  on  P3(00)  may  be  determined  by  the  temporal  rather  than  sequential 
uncertainty  of  events." 

In  light  of  the  theoretical  implications  of  such  inferences,  we  initiated 
a replication  and  extension  of  the  "self-stimulation"  paradigm  in  which  both 
temporal  and  event  uncertainty  were  independently  manipulated.  To  insure  the 
elicitation  of  a P3()Q , series  of  Bernoulli  trials  were  used  in  which  the  two 
possible  stimuli  presented  on  each  trial  had  prooabilities  of  .10  and  .90.  It 
is  well  known  that  if  the  rare  stimuli,  in  this  "oddball"  paradigm  are  made 
task  relevant  by  requiring  the  subjects  to  count  their  occurrence,  a large 
P300  appears  in  the  ERP  elicited  by  the  rare  stimuli  (Squires,  Squires,  & 

Hi llyard , 1975;  Squires,  Donchin,  Herning,  & McCarthy,  in  press). 

Thus  our  design  allows  an  examination  of  the  effects  of  both  temporal  and 
event  uncertainty,  as  well  ac  their  interaction,  on  the  waveform  of  the  ERP. 
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METHODS 

Subjects . Eight  young  adults (5  female,  3 male)  participated  in  the 
study.  Four  of  the  subjects,  including  experimenter  GM,  had  prior  experience 
in  ERP  experiments. 

Stircul j • Tone  bursts  of  either  1000  Hz  or  1500  Hz  (both  at  93  dB  SPL), 
presented  against  a white  noise  background  ( 6f  dB  SPL),  were  delivered 
binaural ly  through  TDH-39  earphones.  Each  tone  had  a total  duration  of  15  msec 
(5  msec  rise-time,  5 msec  fall -time  and  5 msec  steady  level).  The  rather  high 
intensity  tones  and  background  noise  were  necessary  to  mask  the  audible 
operation  of  the  microswitch  used  in  the  self-triggering  conditions. 

Recording  System.  The  EEG  was  recorded  from  nine  Burden  Ag-AgCl  electrodes 
(T3)  Fz,  F^,  C3,  C^,  C^,  P^,  Pz , P^--accordirig  to  the  10-20  system),  eacn 
referred  to  linked  mastoids.  In  addition,  Beckman  Ag-AgCl  electrodes  were 
placed  above  and  below  the  right  eye  to  record  the  electro-oculogram  (E0G).  In 
seven  subjects,  the  ground  electrode  was  placed  on  the  chin,  while  in  one  subject 
it  was  placed  on  the  left  wrist.  Grass  7P122  amplifiers  were  used  to  record 
both  the  EEG  and  E0G.  The  bandpass  was  0.2  Hz  to  35  Hz  (1/2  amplitude  cutoff). 

Data  Collection.  All  aspects  of  data  collection  and  experimental  control 

were  managed  by  a PDP-11/40  computer  system  (Donchin  & Hef^ley,  1975).  The  ten 
channels  of  data  (nine  EEG  and  one  E0G  channel)  were  digitized,  sorted,  and 

averaged  on-line.  For  all  conditions  except  the  ODD  condition  (see  below),  the 

data  were  digitized  at  10  msec/point  for  a 2000  msec  epoch  beginning  1000  msec 
prior  to  stimulus  presentation.  In  the  ODD  condition,  the  data  were  digitized 
at  4 msec/point  for  a total  of  800  msec  beginning  200  msec  prior  to  the  stimulu  . 
Eye  movements  were  detected  on-line  by  a voltage-window  algorithm;  trials  in  which 
E0G  artifacts  occurred  were  not  used  in  the  computation  of  the  averaged  ERPs. 
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Both  sinqle  trials  and  averages  were  stored  on  magnetic  tape  for  off-line 
analysis  on  the  IBM  360/75  of  the  Computer  Services  Office  of  the  University 
of  Illinois.  All  statistical  analyses  were  performed  using  the  SOUPAC  statis- 
tical package  (Dickman,  1974). 

Procedure.  The  subject  was  seated  in  a reclining  chair  in  a dimly  lignted 
booth.  Each  session,  typically  lasting  2 1/2  hours, contai ned  the  following 
conditions.  The  first  two  conditions  are  similar  to  those  used  by  Schafer  and 
Marcus  (1973). 

1.  Self-Stimulation  (SSTM).  In  this  condition  the  subjects  pressed  a 
microswitch  with  the  index  finger  of  their  right  hand  at  intervals  of  their 
choosing.  Subjects  were  cautioned  against  responding  more  frequently  than  once 
every  1500  msec.  Each  switch  closure  immediately  triggered  a 1000  Hz  tone. 

Fifty  (50)  tones  were  presented  in  each  SSTM  run.  The  intervals  between 
successive  stimuli  were  recorded. 

2.  Machine  Stimulation  (MACH).  A series  of  50  tones,  each  of  1000  Hz,  were 
presented  to  the  subject.  These  tones  were  triggered  by  the  computer  using 
intervals  between  successive  stimuli  generated  by  the  subject  in  the  immediately 
preceding  SSTM  condition. 

The  following  two  conditions,  designed  to  assure  the  elicitation  of  a P300 
component,  represent  an  extension  of  the  Schafer  and  Marcus  paradigm. 

3.  Sel f-Stimulation-Oddbal  1 (SSTil-ODD).  This  condition  was  identical  to 
the  SSTM  condition  except  that  each  switch  closure  triggered  either  a 1000  Hz 
tone  or  a 1500  Hz  tone.  The  probability  that  a high  pitch  tone  would  be 
triggered  was  P = .10;  low  pitch  tones  were  triggered  with  a probability  P = .90. 
Subjects  initiated  200  such  trials  and  were  instructed  to  count  the  rare,  high 
pitched,  tones  and  report  their  count  at  the  end  of  a block. 
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4.  Machi ne  Stimulation-Dddbal 1 (HACH-ODD).  A series  of  200  tones  were 
triggered  by  the  computer  at  the  intervals  generated  by  the  subject  in  the 
immediately  preceding  SSTM-ODQ  condition.  Tone  probabilities  were  the  same 
as  in  SSTM-ODD  condition  and  the  subject  was  again  instructed  to  count  the  rare, 
high  pitched  tones. 

Two  additional  conditions  were  used: 

4.  Control  (CONT).  To  allow  an  assessment  of  the  contribution  of  movement 
related  potentials  to  the  SSTM  data,  subjects  ^ssed  the  microswitch  at  their 
own  rate.  No  stimuli  were  triggered. 

6.  Oddball  (ODD).  To  allow  comparison  with  similar  studies  of  P300  a 
series  of  200  t^nes  ( P( 1 000  Hz)  = .90;  P ( 1 500  Hz)  = .10),  were  triggered  by 
the  computer.  The  interstimulus  interval  was  fixed  at  1600  msec. 

With  the  constraint  that  machine-triggered  series  followed  the  corresponding 
self-triggered  series,  the  order  of  experimental  conditions  was  balanced  over 
the  subjects. 
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RESULTS 

The  mean  IS  Is  associated  with  the  SSTfl  and  SSTM-ODD  conditions  (and, 
consequently,  with  the  MACH  and  MACH-ODD  conditions)  varied  among  subjects 
from  3400  msec  (standard  deviation  (sd)  = 911  msec)  to  9739  msec  (sd  = 1881  msec) 
for  the  SSTM-ODD  conditions  and  from  4140  msec  (sd  = 1104  msec)  to  8634  msec 
(sd  = 1575  msec)  for  SSTM.  Within  subjects,  ISIs  for  SSTM  and  SSTM-ODD  were 
quite  similar;  deviating  at  most  by  1155  msec. 

ERP  Waveforms.  A summary  of  the  data  is  presented  in  Figure  1 where 
waveforms  averaged  across  subjects  for  each  experimental  condition  ("grand- 
averages”)  are  shown  (data  from  a typical  subject  are  displayed  in  Figure  2). 

The  data  acquired  in  the  ODD  condition  replicate  in  all  respects  data  acquired 
in  other  laboratories  (Ritter,  Vaughan,  & Costa,  1968;  Squires,  N.  et  al . , 1975) 
as  well  as  in  our  own  (Squires,  K.  et  al . , in  press).  A large  P300  component 
is  associated  with  the  counted  rare  tones,  and  is  absent  in  the  frequent  tone  ERP. 

A comparison  of  the  waveforms  from  the  SSTM  and  MACH  conditions  (which 
differed  only  in  the  mode  of  stimulus  initiation)  revealed  that  the  negative 
peak  with  a latency  of  approximately  140  msec  (N140)  was  enhanced  in  the  MACH 
condition.  This  effect  was  largest  centrally,  smaller  at  the  frontal  electrodes, 
and  smallest  at  the  parietal  electrodes.  This  negative  peak  and  the  following 
positive  trough  also  appeared  with  a somewhat  shorter  latency  in  the  SSTM 
condition. 

A more  complex  ERP  waveform  was  associated  with  the  SSTM-ODD  and  MACH-ODD 
conditions.  Again,  the  NT40'  associated  with  the  I1ACH-0DD  condition  was  larger 
than  the  cot  responding  peak  in  ttie  SSfM-ODD  condition;  this  effect  occurring 
primarily  at  C^  and  Fz.  Again,  a latency  difference  was  observed  with  earlier 
latencies  apparent  in  the  SSTM-ODD  waveforms.  As  in  the  ODD  waveforms,  a 
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prominent  P300  component  was  associated  with  the  counted  rare  tones.  Tnis  is 
most  clearly  seen  at  ?z  where  (except  for  latency  differences)  the  ERPs  to 
the  self-triggered  and  machine-triggered  tones  were  nearly  identical.  At  C 
hov/ever,  the  MACH-ODD  and  SSTM-ODD  waveforms  were  quite  dissimilar,  the  prominent 
P300  which  can  be  observed  in  the  SSTM-ODD  waveform  was  not  present  in  the 
MACH-ODD  waveform. 

The  data  elicited  during  the  CONT  condition  in  which  no  auditory  stimulus 
was  presented  may  be  used  tc  assess  the  extent  to  which  the  switch-depression 
may  account  for  the  differences  between  the  SSTM  and  MACH  data.  The  records 
exhibit  considerable  post-movement  positive  activity  and,  at  C , a small  amplitude 
premovement  negative  shift  can  be  seen.  These  data  suggest  that  the  ERPs  recorded 
in  each  of  the  self-triggered  conditions  may  have  been  "contaminated"  by  movement- 
related  potentials;  the  CONT  waveforms  were,  therefore,  subtracted  point-by- 
point from  both  the  SSTM  and  SSTM-ODD  waveforms.  In  Figure  3 MACH  with  SSTM 
ERPs  are  compared  both  before  and  after  subtraction  of  the  CONT  waveforms  from 
the  SSTM  waveforms.  The  latency  differences  between  SSTM  and  MACH  ERPs  which 
appear  in  the  left  column  disappear  after  the  movement-related  potentials  were 
subtracted  from  the  SSTil  ERPs.  It  should  be  noted  that  after  the  removal  of 
motor  potentials,  the  SSTM  ERPs  virtually  disappear.  It  seems,  therefore,  that 
little,  if  any,  stimulus  evoked  activity  was  recorded  in  the  SSTM  condition. 

Note  also  the  partial  restoration  of  N140  amplitude  in  the  SSTM-ODD  wave- 
forms after  subtraction.  This  effect  is  most  apparent  for  the  waveforms  elicited 
by  the  frequent  tones  where  N140  amplitudes  are  nearly  identical  at  Cz  for  both 
MACH-ODD  and  SSTM-ODD.  ERPs  elicited  by  the  , are  tones,  however,  still  differ 
in  NT 40  amplitude  with  MACH-ODD  waveforms  displaying  larger  amplitude. 
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Principal  Component  Analysis.  The  above  impressions  were  derived  by 
visual  inspection  of  the  averaged  waveforms.  To  quantify  and  further  evaluate 
the  effects  of  the  independent  variables  on  the  different  components  of  the 
ERP,  a Principal  Component  Analysis  (PCA)  of  the  waveform  data  was  performed. 

The  application  of  this  multivariate  analysis  technique  to  ERP  data  has  been 
treated  by  Donchin  (1966,  1969)  and  illustrated  by  Donchin,  Tueting,  Ritter, 
Kutas,  and  Heffley  (1975)  and  Squires,  K.  et  al . ( n press).  A PCA  of  a 
data  set  yields  two  major  results--a  statement  about  the  orthogonal  components 
into  which  the  data  matrix  can  be  factored  and  a measure  of  the  contribution 
of  each  of  the  principal  components  to  each  of  the  ERPs. 

For  each  of  the  principal  components  a set  of  "factor-loadings"  is  obtained. 
There  is  a loading  for  each  component  per  time  point  of  the  recording  epoch. 

The  loading  is  a measure  of  the  degree  of  association  between  the  hypothetical 
component  and  the  time  point.  The  principal  components  represent  the  ERP 
components  which  appear  in  the  time  segment  in  which  the  factor  is  highly 
loaded.  The  contribution  of  a component  to  an  ERP  waveform  is  measured  by  the 
"factor-scores,"  v/hich  are  analogous  to  the  base-to-peak  component  measures 
which  are  often  used  in  ERP  studies  (see  Squires,  K.  et  al . for  a discussion 
of  tni:  issue).  The  fact  ;r  scores  have  the  advantage  i nter  alia  that  a separate 
analysis  of  variance  can  be  performed  on  the  scores  obtained  for  each  component. 

Two  separate  PCA  were  conducted,  one  on  data  obtained  in  tne  SSTM  and 
MACH  conditions  and  one  on  the  SSTM-CDD  and  MACH-ODD  conditions.  The  input 
to  the  PCA  in  each  case  was  the  cross-products  matrix  formed  by  obtaining  the 
cross-products  of  the  voltage  values  at  all  possible  pairs  of  time  points 
(thus  the  element  in  the  i-th  row  and  j-th  column  of  the  matrix  is  obtained 
by  multiplying  the  values  at  the  i-th  and  j-th  time-point  in  each  ERP  and 
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summing  the  products).  The  variance  accounted  for  by  the  first  6 factors  v/as 
84/,  in  the  SSTM/MACH  PCA  and  85%  in  the  SSTM-ODD/MACH-ODD  PCA.  Each  set  of 
components  was  rotated  using  the  Varimax  procedure,  and  the  loadings  for 
both  analyses  are  plotted  in  Figure  4. 

It  is  clear  from  Figure  4 that  the  extracted  components  correspond  to  each 
of  the  major  ERP  components  discussed  in  conjunction  with  the  Grand-Averages. 

The  two  PCAs  differ  primarily  in  that  a component  whose  maximal  loadings  appear 
380  msec  after  the  stimulus  is  extracted  from  the  SSTM-ODD/KACH-ODD  analysis 
but  not  in  the  SSTM/MACH  analysis.  In  both  analyses  two  factors  are  extracted 
with  maximal  loadings  at  140  msec  and  200  msec,  and  two  with  fairly  broad 
ranges;  one  covering  the  epoch  just  preceding  the  stimulus  and  the  other  covering 
tne  period  from  about  500  msec  after  the  stimulus  to  the  end  of  the  analysis  epoch. 

The  extracted  components  are  best  interpreted  by  referring  to  the  behavior 
of  the  factor-scores  as  a function  of  the  various  experimental  variables.  For 
the  purposes  of  this  analysis  we  view  the  experimental  design  as  a repeated 
measures  factorial  design.  In  the  SSTM/MACH  data  the  factors  are  the  electrodes 
and  the  mode  of  stimulus  presentation.  For  the  SSTM-0DD/MACH-0DD  matrix  the 
stimulus  type  (rare  vs.  frequent)  is  added.  This,  in  fact,  was  the  rationale 
for  the  separate  analyses  of  these  data-sets. 

The  results  for  the  several  factors  can  be  summarized  as  follows:^ 

Component  I from  the  SSTM/MACH  analysis  can  be  identified  with  the  Nl 40 
component  of  the  ERP.  It  is  largest  at  C2  (F(8/56)  = 2.67,  MSg  = 0.001)  with 
a sharp  posterior  grad  ent.  It  is  significantly  affected  by  mode  of  stimulus 
presentation  (F(l/7)  = 10.34,  MSg  = 0.0271),  being  larger  in  the  MACH  condition. 
Similar  results  were  obtained  from  the  SSTM-0DD/MACH-0DD  analysis.  This  factor 
also  tends  to  be  larger  for  the  rare  than  for  the  frequent  stimuli  in  the 
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MACH-ODD  condition  (F(l/7)  - 9.74,  MSp  = 0.005).  These  analyses  thus 
corroborate  the  inferences  we  drew  from  the  grand  averages  concerning  the  N14T) 
component. 

The  component  which  peaks  200  msec  after  the  stimulus  is  related  to  the 
P2b0  component  of  the  (RP.  It  is  largest  at  Cz  with  a sharp  frontal  gradient 
(F(8/56)  = 4.04,  MSg  = 0.0015  for  SSTM/MACH).  None  of  its  relations  to  other 
experimental  variables  are  statistically  significant. 

It  seems  reasonable  to  identify  the  prestimulus  component  with  the 
Readiness  Potential  (RP).  In  both  data-sets  there  is  an  interaction  between 
the  mode  of  stimulus  presentation  and  the  recording  electrode  ( F (8/56 ) = 3.19, 

MSe  = 0.0007  for  SSTM -00D/MACH-0DD) . An  examination  of  the  factor-scores  shows 
this  component  to  be  present  primarily  at  the  central  electrodes  in  the  self- 
stimulation conditions.  Moreover,  it  is  larger  at  than  at  , as  would  be 
expected  of  an  RP  with  the  subjects  responding  with  their  right  hand  (Kutas  & 

Donchin,  1974). 

The  component  associated  with  the  later  part  of  the  epoch  displays  complex  rela- 
tionships with  the  independent  variables.  For  the  SSTM/MACH  analysis,  this 
component  appears  positive-going  at  all  electrode  sices.  It  is  maximal  at  C? 
for  the  SSTM  waveforms  while  essentially  absent  for  the  MACH  condition  (F(l/7)  = 

5.33,  M$e  = 0.0117).  The  SSTM-0DD/MACH-0DD  analysis  shows  that  both  mode  of 
stimulus  presentation  and  probability  of  presentation  affect  the  distribution 
of  this  factor.  The  three-way  interaction  of  these  variables  (F(8/56)  = 2.39, 
g.  5 MSg  = 0.0006)  summarizes  these  complex  effects  (see  Figure  5).  For  the  computer- 
presented  rare  tones,  this  component  is  negative  going  in  the  frontal  electrodes, 
is  nearly  absent  in  the  centrals,  and  is  positive  going  in  the  parietal  electrode. 

For  the  computer-generated  frequent  tones,  this  component  is  near  zero  for  all 


electrode  position?.  Thus,  this  component  has  many  of  the  attributes  of  the 
Slow  Wave  (SW)  component  of  the  ERP  originally  described  by  Squires,  N.  et  al . 
(1975).  For  the  sel f-tri ggered  frequent  tones,  this  factor  is  positive  at  all 
sites,  while  for  the  rares  it  is  much  reduced  or  zero  at  each  site.  This 
result  may  reflect  a complex  interaction  between  two  slow  positive  components, 
one  relating  to  the  rarity  of  the  stimulus  while  the  other  is  related  to  the 
motor  response. 

The  component  peaking  at  380  msec  is  unique  to  the  SSTM-ODD/MACH-ODD  data. 

The  factor-scores  indicate  that  this  factor  is  largest  parietally  ( F (8/56 ) = 9.46, 
MSg  = 0.0007)  and  appears  only  to  the  rare  tones  (F(l/7)  = 14.79,  MSe  = 0.0146). 
This  component  can  thus  be  identified  as  the  P'300  component.  Note  that  mode  of 
stimulus  presentation  strongly  affects  this  factor.  At  C2,  P300  is  larger  for 
self-stimulation  than  for  machine-presented  stimuli  ( F ( 8/56 ) = 2.12,  MSe  = 0.0004). 
This  effect  is  much  reduced  at  P2< 

To  summarize,  five  distinct  components  emerge  from  the  combined  data  and 
show  systematic  relationships  with  the  experimental  variables.  The  N140,  P200, 

RP,  and  SW  components  appear  in  both  data  sets.  There  is  reason,  however,  to 
suspect  different  bases  for  the  SW  component  in  each  data  set;  a frontal- 
negative, parietal  positive-going  wave  to  machine  presented  rare  tones  as 
described  by  N.  Squires  et  al . (1975),  and  a central  dominant  positive-going 
wave  related  to  movement.  The  P300  component  is  uniquely  associated  with  the 
rare  tones  presented  in  the  oddball  paradigms.  We  have  not  found  P300  to  be 
associated  with  all  stimuli  whose  time  of  occurrence  is  uncertain.  Yet,  the 
mode  of  stimulus  presentation  does  affect  the  distribution  of  P300,  seeming 
to  reduce  its  amplitude  at  C2,  without  much  of  an  effect  on  its  amplitude  at  P.,. 
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DISCUSSION 

To  a degree,  our  data  confirm  the  report  by  Schafer  and  Marcus  (1973). 

The  ERPs  associated  with  stimuli  which  have  been  triggered  by  the  subject  are 
indeed  different  from  ERPs  elicited  by  the  same  stimuli  when  triggered  by  a 
computer.  Yet  in  detail  our  data  paint  a picture  quite  different  from  that 
outlined  by  Schafer  and  Marcus,  who  reported  effects  which  seemed  equally  potent 
for  all  components  of  the  ERP.  A global  enhancement  of  the  ERP  waveform  is 
often  attributed  to  generalized  changes  in  the  subject's  arousal  level  (Haider, 
Spong,  & Lindsley,  1964).  A strong  case  can,  however,  be  developed  against 
attempts  to  treat  the  ERP  as  a global  unitary  phenomenon  whose  components 
respond  in  unison  to  experimental  manipulations  (Donchin,  1969,  1975).  The 
weight  of  the  evidence  leans  towards  a view  of  the  ERP  as  a sequence  of  serially 
elicited  components,  representing  distinct  intra-cerebral  processes,  each 
responding  in  a distinct  way  to  experimental  manipulations  (Picton,  Hillyard, 
Krausz,  & Galambos,  1974). 

The  data  reported  here  are  in  accord  with  the  view  of  the  ERP  as  a sequence 
of  components.  Again,  the  effects  of  different  experimental  variables  were 
localized  to  a subset  of  the  ERP  components.  As  has  oeen  repeatedly  shown  in 
t.he  past,  the  presentation  of  task  relevant,  rare,  events,  is  associated  with 
a large  P300  component  (cf.  Price  & Smith,  1974  for  bibliography).  Two  effects 
are  associated  with  the  mode  of  stimulus  triggering,  a Readiness  Potential 
precedes  the  switch  closure  in  the  SSTM  conditions  and  the  NT40  component  of 
the  ERP  is  enhanced  when  the  stimulus  is  presented  at  a temporal  sequence  which 
the  subject  cannot  reliably  predict  (in  the  MACH  conditions;. 

At  first  inspection,  the  N1 40  component  elicited  by  subject-triggered 
tones  appears  earlier  in  latency  than  that  elicited  by  computer-triggered  tones, 
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as  reported  by  Schafer  and  Marcus  (1  973).  However,  after  correction  for 
movement-related  potentials,  this  latency  shift  can  no  longer  be  observed. 

The  failure  of  Schafer  and  Marcus  to  see  such  movement-related  potentials  in 
their  data  may  be  due  to  the  frequency  response  of  their  recording  system. 

They  report  their  amplifiers  to  have  a low  cutoff  point  at  3 Hz,  clearly  above 
the  range  required  for  recording  Readiness  Potentials. 

Subtraction  of  the  estimated  contribution  of  the  Readiness  Potentials 
affected  the  observed  amplitude  of  NTTO.  In  the  SSTM  condition  there  seemed 
to  be  virtually  no  f RP  waveform  after  the  RPs  were  subtracted.  In  the  SSTM-ODD 
and  in  the  MACH-ODD,  a clear  auditory  ERP  could  be  observed  in  the  residuals. 
Moreover,  the  NTO  was  larger  in  the  MACH-CDD  than  in  the  SSTM-ODD,  especially 
in  association  with  the  rare  tones.  It  is  possible,  then,  that  these  data 
present  yet  another  demonstration  of  the  lability  of  the  NT40  component  and  its 
sensitivity  to  the  direction  of  the  subject's  attention  to  stimuli.  Hillyard 
and  his  associates  (Hillyard,  Hink,  Schwent,  & Picton,  1973;  Picton  & Hillyard, 
1974)  have  reported  that  the  amplitude  of  "Nl",  which  we  assume  to  be  identical 
to  our  NW,  is  enhanced  when  subjects  direct  their  attention  to  one  of  several, 
simultaneously  presented,  sources  of  information.  It  is  plausible  to  assume 
that  on  a scale  of  task-demands,  the  SSTM  condition  ranks  lowest.  The  SSTM-ODD, 
in  which  the  subject  has  to  discriminate  the  intensity  of  a stimulus  whose 
arrival  time  he  knows  ranks  second,  while  the  MACH-ODD  condition  in  wnich 
stimulus  arrival  time  is  also  unknown  is  most  demanding.  This,  of  course,  is 
a post-hoc  explanation  of  the  "self-stimulation"  effect  as  we  have  no  independent 
measure  cf  the  subject's  attentional  strategies.  Yet  it  is  consistent  with 
the  data.  Localizing  the  effect  to  a specific  component  whose  response  to 
experimental  variables  is  known  enables  an  interpretation  of  the  effect  within  a 
valid  framework. 
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The  effects  of  temporal  uncertainty  on  the  P300  component  are  of  interest. 
We  find  that  by  itself,  temporal  uncertainty  is  not  sufficient  to  elicit  a P300. 
This  component  appeared  only  in  response  to  rare  stimuli,  and  at  the  parietal 
electrodes  it  seemed  not  to  matter  whether  the  stimulus  was  machine  or  subject- 
generated . 

One  cannot  deduce  from  these  data  that  temporal  uncertainty  never  affects 
P300  amplitude.  It  is  conceivable  that  the  degree  of  uncertainty  associated 
with  the  temporal  characteristics  of  the  stimulus  train  was  lower  than  that 
associated  with  the  occurrence  of  the  rare  and  frequent  stimuli.  A definitive 
answer  awaits  the  development  of  commensurate  stales  of  temporal  and  event 
uncertainty.  Yet  it  is  interesting  that  while  temporal  uncertainty  did  affect 
the  Ml 40  component  it  failed  to  enhance  P300.  Such  a dissociation  between  Ml 40 
and  P300  effects  is  consistent  with  the  findings  of  Ford,  Roth,  Dirks,  and 
Kopell  (1973).  It  implies,  we  believe,  that  unlike  M40  which  may  be  related 
to  generalized  allocation  of  attention  to  a task,  or  to  an  information  source, 
P300  is  a manifestation  of  the  activation  of  a specific  processor  called  into 
action  by  the  information  conveyed  by  the  specific  stimuli  in  the  sequence. 

The  present  data  suggest  that  the  serial  context  within  which  the  stimuli  are 
presented  is  more  important  than  fluctuations  in  stimulus  presentation  time. 
Again  we  find  as  did  Donchin,  Kubovy,  Kutas,  Johnson,  and  Herning  (1973)  that 
uncertainty  reduction"  by  itself  does  not  suffice  as  an  explanatory  concept 
for  the  P300  component. 

In  this,  our  conclusions  differ  from  those  drawn  by  Ford  et  al . (1976). 

These  investigators  presented  subjects  with  tones  designated  a*  targets  at  a 
rate  of  1 per  secowd.  These  were  to  be  compared  to  standard  tones  presented 
ai  the  rate  of  I,  2 or  4 per  second.  The  varying  rate  of  standard  presentation 
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resulted  in  different  sequential  probabilities  for  the  appearance  of  the 
target.  Ford  et  al . did  not  find  sequential  orobability  to  have  an  effect  on 
PlffiJ  amplitude.  They  attribute,  therefore,  the  POT  differences  they  did 
observe  to  temporal  uncertainty.  Yet,  we  note  that  they  confound  sequential 
w’th  global  probability.  As  they  increase  the  rate  of  standard  presentation, 
the  number  of  standard  stimuli  per  unit  time  increases.  As  they  were  unable 
to  dissociate  the  multiple  effects  of  stimulus  density,  it  is  difficult  to 
accept  their  data  as  demonstrating  an  effect  of  temporal  uncertainty  on  P300. 

Strangely,  temporal  uncertainty  appears  to  selectively  diminish  the 
amplitude  of  the  P300  component  at  the  central  electrodes.  The  diminution  of 
P300  at  in  the  MACH-ODD  condition  cannot  be  attributed  to  an  increase  in 
the  temporal  jitter  in  the  response  to  stimuli  whose  time  of  arrival  is  unknown. 
Such  temporal  jitter  would  have  affected  ?z  and  Cz  to  an  equal  extent.  Note 
that  the  snape  of  the  P300  at  Pz  is  equally  peaked  for  both  the  SSTM-ODD  and 
MACH-ODD  conditions.  The  dissociation  between  parietal  and  central  P300  cannot 
be  attributed  to  positive  components  of  the  RP  as  the  difference  survives 
subtraction  of  the  RP  (see  Figure  3). 

This  dissociation  between  the  Pz  and  the  Cz  P300  has  not  been  previously 
reported,  and  unfortunately , a ready  explanation  cannot  be  derived  from  these 
data.  Perhaps  the  long  interstimulus  intervals  are  a factor.  In  fact  the 
correlation  between  ISI  and  POT  (measured  by  the  factor  scores)  is  -.587 
indicating  that  P300  tends  to  be  diminished  with  increasing  ISI.  Further 
research  is  clearly  required  on  the  relationships  between  POT  amplitudes  and 
the  temporal  sequence  of  the  stimulus  series.  As  Donchin  and  Smith  (1970)  have 
stated,  "These  results  point  to  the  importance  of  considering  the  experimental 
situation  in  an  AEP  experiment  not  as  a series  of  isolated  stimuli,  the  response 
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to  which  is  to  be  determined,  but  as  a continuous,  on-going  process  in  which 
the  subject's  response  to  each  stimulus  is  conditioned  by  (is  expectancies 
with  regard  to  future  stimuli  and  his  experiences  with  pasc  stimuli."  The 
details  of  the  stimulus  presentation  sequences,  as  well  as  the  successive 
intervals  between  stimuli  appear  to  be  equally  important.  Studies  in  this 
laboratory,  reported  elsewhere  (Squires,  Wickens,  Squires,  & Donchin,  submitted) 
demonstrate  a strong  relationship  between  P300  amplitude  and  the  disconfirmation 
of  expectancies,  where  expectancy  is  determined  by  multiple  factors  such  as 
the  global  probability  of  a stimulus,  the  immediate  past  history  of  stimulus 
presentations  as  well  as  the  microstructure  of  the  series.  Thus,  the  effects 
of  either  temporal  or  event  uncertainties  must  be  assessed  in  terms  of  trial - 
by-trial  variations  in  expectancy,  rather  than  as  consequences  of  loosely 
defined  uncertainties. 

In  conclusion  Schafer  and  Marcus  were  correct  in  pointing  out  the  importance 
of  stimulus  presentation  mode  on  the  waveform  of  the  ERP.  The  effects,  however, 
appear  to  be  distinct  at  different  ERP  components  and  may  well  be  a corollary 
of  the  effects  which  presentation  mode  may  have  on  the  subject's  perception 
of  his  tasks. 
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FOOTNOTE 
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All  references  to 


stati stical 


significance  assume  an  alpha  level 


of  .05  (p  < .05). 
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FIGURE  LEGENDS 

Figure  1.  Waveforms  of  the  ERP , obtained  by  averaging  data  from  all  subjects, 
are  depicted  for  each  experimental  condition.  Averages  for  each  of  the 
eight  subjects  are  overlapped  for  the  SSTM,  MACH,  and  CONT  conditions  to 
illustrate  the  degree  of  intersubject  variability.  Upward  deflections, 
in  all  waveforms,  represent  negative  polarity. 

Figure  2.  Averaged  waveforms  for  subject  D.H.  for  each  of  the  experimental 

conditions  are  shown.  Waveforms  elicited  by  subject  and  machine  presented 
tones  are  overlapped  for.tjie  SSTM/ MACH  and  SSTM -ODD/MACH-ODD  (both  frequent 
and  rare  tones)  conditions. 

Figure  3.  Grand-averaged  waveforms  elicited  by  subject  and  machine  initiated 
tones  are  shown  overlapped.  The  lower  traces  for  the  subject  initiated 
conditions  represent  those  data  after  point  by  point  subtraction  of  the  motor 
control  (CONT)  waveforms.  In  both  upper  and  lower  traces,  the  machine 
initiated  conditions  are  the  same  to  allow  comparison. 

Figure  4.  Factor  loadings  for  both  SSTM/PLACH  and  SSTM-ODD/MACH-ODD  analyses 
are  plotted.  The  numbering  of  each  component  is  with  reference  to  their 
discussion  in  the  text  and  not  in  the  order  of  their  extraction  by  the 
Varimax  rotation  procedure.  The  analyses  were  performed  on  2000  msec  of 

data,  including  1000  msec  of  prestimulus  EEG. 

✓ ■ 

Figure  5.  The  mean  factor  scores  for  the  electrode  X mode  (of  stimulus  presentation) 
X stimulus  probability  interaction  for  the  long  latency  slow  component  (IV 
from  Figure  4)  of  the  SSTM-ODD/MACH-ODD  analysis  are  depicted. 
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VARIATIONS  IN  THE  LATENCY  OF  P300  AS  A FUNCTION  OF 
VARIATIONS  IN  SEMANTIC  CATEGORIZATION'S 

M.  Kutas  and  E.  Donchin 
Department  of  Psychology 
University  of  Illinois 
Champaign,  Illinois  61820 

Several  recent  studies  of  P300  utilized  the  following  experimental  para- 
digm. The  subject  is  presented  with  a stream  of  stimuli,  each  of  which  may 
belong  to  one  of  two  categories.  The  subject  counts  and  reports  verbally  the 
number  of  stimuli  which  belong  to  one  of  the  two  categories.  The  probability 
is  low  that  a stimulus  will  belong  to  one  of  the  categoriej  and  correspondingly 
high  that  it  will  belong  to  the  other  category.  Stimuli  categorized  into  the 
low  probability  category  elicit  an  enhanced  P300  component  (Ricter  & Vaughan, 
1969;  Squires,  Squires  £,  Hillyard,  1975;  Tutting,  Sutton  & Zubin,  1971).  In 
most  of  the  experiments  reported  to  date,  the  categorizations  required  of  the 
subject  were  based  on  such  physical  features  of  the  stimuli  as  the  frequency 
of  tones,  the  hue  of  light-  flashes,  the  specific  pattern  of  the  visual  stimulus 
etc.  It  seemed  necessary  to  determine  if  the  same  results  would  be  observed 
if  the  categorization  required  of  the  subject  was  based  on  semantic  features 
of  the  stimuli  (see  Friedman,  Fimson,  Ritter  6 Rapin,  1975).  For  this  purpose 
we  presented  6 subjects  with  sequences  of  words.  Each  word  could  be  categorized 
on  the  basis  of  a semantic  rule,  into  one  of  two  categories.  The  two  categories 
appeared  with  the  probability  of  either  .20  or  .80.  Our  intent  was  to  determine 
the  extent  to  which  the  aopearance  of  stimuli  belonging  to  the  rare  category 
would  enhance  the  P300  component.  As  the  complexity  and  latency  of  the  cate- 
gorization response  depended  on  the  complexity  of  the  categorization,  the 
data  could  also  be  examined  lor  the  relationship  between  the  duration  of  the 
cognitive  operations  required  0;  the  Suhjec  • and  the  1 
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component . If  P300  is  a manif es tat  inn  rhr  v 

mam  tee  tat  ion  the  invocation  of  a specific  cogniti/e 

processing  activity  (Donchin  197  v , 

y nciun,  19/5,  Donchin,  Lubovy,  Kutas,  Johnson  d Herning, 

1973)  then  the  latency  of  the  P300  relative-  to  the  physical  stimuius  would 
depend  on  the  latency  and  duration  of  the  cognitive  process  and  would  vary 
as  a function  of  the  complexity,  and  therefore  the  duration,  of  the  cognitive 
Process.  This  proposition  was  tested  in  the  present  study. 

The  experiment  utilised  PUTO,  a computer  assisted  instruction  system 
developed  at  the  University  of  Illinois.  The  PLATO  terminal  uses  a plasma 
panel  for  display  (Stifle,  1974).  Several  hundred  such  terminals  are  supported 
by  a central  computer  facility.  The  terminal  provides  for  the  presentation  of 
rather  elaborate  graphics  and  an  almost  unlimited  rnnge  of  possibilities  for 
presenting  visual  stimuli  to  the  subject.  The  terminal  is  also  provided  with 
an  external  trigger  output  which  can  be  generated  under  program  control.  The 
display  is  achieved  by  illuminating  any  of'  512  x 512  luminous  dots.  In  this 
experiment  the  PLATO  system  was  programmed  to  present  a sequence  of  words  on 
the  terminal,  one  at  a time.  Each  word  was  preceded  by  an  external  trigger 
signal  which  was  led  to  a PDP8/e  computer.  This  trigger  activated  the  digi- 
tizing process  so  that  LEG  data  would  be  acquired  in  relation  to  the  presenta- 
tion  of  the  stimuli. 

We  report  here  data  from  three  studies.  In  each  study  subjects  were 

presented  with  four- different  sequences  of  words.  Each  sequence  consisted 

about  250  words,  each  belonging  to  one  of  two  categories.  Each  stimulus  was 

selected  randomly  on  any  trial  with  the  appropriate  probability.  The  series 
used  are  described  below. 

(1)  Fixed  names.  The  words  presented  to  the  subjects  would  be  either 
Nancy"  or  "David."  The  name  "Nancy"  appeared  2CZ  of  the  time. 

(2)  ~ aMe  The  "°rds  Panted  to  the  subject  could  be  selected 

from  a list  of  20  female  names  and  20  male  names.  20*  of  the  names  selected 

er°a  th€  FemdU  name  Ust  and  hOt  from  the  male  run*,  list  (e.S.t  Urr*. 
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Henry) . 

(3)  Rhynes.  The  words  were  selected  either  from  a list  of  words  rhyming 

with  the  word  "cake”  (e.g.,  steak,  bake)  or  from  a list  of  20  arbitrary  words. 

The  rhymes  were  presented  20%  of  the  time. 

(4)  Synonyms . The  words  selected  were  from  a list  of  20  arbitrarily  chosen 
words  and  9 synonyms  or  the  word  "prod"  (e.g.,  poke,  goad)..  The  synonyms  were 
presented  20%  of  the  time. 

Brain  potentials  were  monitored  with  Burden  electrodes  placed  at  Fz,  Cz, 

Pz,  C3  and  C4  referred  to  linked  nastoids  in  the  first  experiment  and  the  chin 

in  the  others.  The  EOG  was  recorded  between  supraorbital  and  canthal  positions. 
The  subject  was  grounded  on  the  forehead.  The  EEG  was  amplified  by  Brush 
amplifiers  (011-4307-02)  with  a 2 sec  time  constant  and  30  Hz  high  frequency 
cut-off  (1/2  amplitude) . A Hewlett  Packard  EM  tape  recorder  (3955)  was  used 
to  record  analog  data.  Recording  was  done  at  1 7/8  inches  per  second.  Data 
were  digitized  off-line  by  an  IBM  1800  and  stored  on  digital  magnetic  tape. 
Digitizing  started  250  msec  prior  to  the  stimulus  and  ended  1000  msec  later. 

The  sampling  rate  was  10  msec  per  point.  A PDP  8/e  computer  determined,  on 
line,  whether  eye  movement  artifacts  were  present  during  each  trial  by  comparing 
the  EOG  variance  to  a criterion  value.  Contaminated  trials  were  not  included 
in  the  average. 

The  subject  sat  in  a comfortable  chair  in  a semi-darkened  shielded  room. 

Each  subject  was  run  through  the  different  conditions  in  order:  Fixed  names. 

Variable  names,  Rhymes  and  Synonyms.  Prior  to  each  block  of  approximately  250 
trials  the  subject  was  instructed  to  watch  the  words  and  count  stimuli  from 
the  rare  category.  At  the  end  of  each  session,  the  subject  was  asked  to  report 
his  count. 

Six  subjects  were  run  in  the  first  experiment  in  which  the  subject's  task 
was  to  count  the  number  of  stimuli  belonging  to  the  rare  category.  Figure  1 


141c 


Insert  Figure  1 Here 


presents  the  data  from  one  subject  and  super-averages  computed  over  the  data 
from  the  entire  subject  group.  Evoked  responses  elicited  by  stimuli  belonging 
to  the  frequent  category  lack  a P300  component.  The  ERPs  elicited  by  stimuli 
belonging  to  the  rare  category  show  a marked  P300  component.  Also,  the  latency 
of  the  P300  component  varies  widely.  The  latency  is  shortest  for  the  fixed- 
name  categorization  and  longest  for  the  synonyms.  The  variable  names  and  the 
rhyming  words  show  intermediate  latencies.  This  ranking  of  latencies  character- 
ize the  data  obtained  from  all  subjects.  There  were  also  differences  in  the 
amplitude  of  the  P300  component  over  the  four  conditions. 

These  data  demonstrate  that  the  P300  response  is  associated  with  the  cate- 
gorization of  the  stimuli  even  when  the  categorization  depends  on  semantic 
rather  than  on  physical  characteristics  of  the  stimuli.  Even  though  averaging 
is  over  a diverse  array  of  physical  stimuli,  such  as  the  different  female  names 
used  m Hese  lists,  a clear  P300  response  is  elicited.  The  data  are  consistent 
with  the  suggestion  that  the  latency  of  P300  varies  systematically  with  the 
complexity  of  information  pro:essing  required  of  the  subject,  suggesting  that 
P300  latencies,  even  though  varying  with  respect  to  the  physical  stimulus,  are 
uniform  relative  to  the  time  at  which  the  putative  cognitive  activity  underlying 
their  appearance  occurs.  This  conclusion  is  supported  by  the  fact  that  there 

were  no  apparent  differences  in  the  scalp  distribution  of  the  P300  associated 
with  the  four  series. 

In  an  attempt  to  validate  the  extent  to  which  the  differences  between  the 
series  are  in  fact  related  to  different  subject  decision-times,  we  repeated 
the  experiment  with  5 other  subjects,  asking  that  they  respond  rapidly  by 
pressing  one  of  two  buttons  upon  the  appearance  of  any  stimulus  from  the  two 
categories.  The  results  arc  shown  in  Figure  2.  The  data  obtained  in  Experiment 
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2 differ  from  those  obtained  in  F,xperiment  1 in  two  important  respects.  First, 
it  appears  th3t  the  execution  of  a motor  response  changes  the  appearance  of 
the  "frequent"  evoked  response  in  that  a positive  component,  presumably  the  ?2 
of  the  motor  potential,  can  be  observer.  This  positivity  cannot  fully  account 
for  the  rather  marked  enhancement  of  the  positivity  with  the  latency  of  about 
P400  associated  with  the  rare  stimuli.  The  latencies  obtained  in  this  second 
experiment,  however,  are  somewhat  iess  differentiated  than  those  observed  in  the 
first  experiment.  The  fixed  names  latency  is  still  considerably  shorter  than 
that  associated  with  the  ether  three  conditions,  however,  these  three  conditions 
are  no  longer  as  differentiated  as  they  were  during  the  count  condition.  The 
reaction  times  associated  with  these  four  experimental  conditions  are  consistent 
with  the  latencies  of  P300. 

The  failure  to  observe  differences  in  the  latency  of  P300  with  3 of  the 
A experimental  conditions  could  be  attributed  to  the  fact  that  in  the  second 
er  stiment  we  emphasized  speed  without  requit  >.  0 the  sub_,  ct  to  be  accurate  in 
hi-  categorizations.  Thus  subjects  tended  to  execute  erroneous  categorizations 
as  they  attempted  to  minimize  their  response  speed  e error  rate  across  the 
different  experimental  conditions  varied,  Clean  subjects  could  have 

traded  accuracy  for  speed.  A third  expe  at  was  therefore  run.  This  time 
we  did  not  use  the  "rhymes"  series.  Each  subject  was  run  under  three  experi- 
mental conditions,  with  each  of  the  series.  The  "count"  condition  replicated 
Experiment  1;  the  "RT-Speed"  condition  replicated  Experiment  2 while  in  the 
"RT-Accurate"  condition  subjects  made  a choice  reaction  to  the  stimulus  but 
were  instructed  to  be  very  accurate,  never  pressing  the  wrong  button.  The 
results  are  shown  in  Figure  3.  Clearly,  when  accuracy  is  emphasized  P300 
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Insert  Figure  3 Here 

latencies  vary  with  the  series  in  the  same  manner  they  vary  in  the  "count" 
conditions.  When  speed  is  of  prime  consideration,  the  subjects  seem  to  maximize 
speed  by  reducing  the  processing  time  they  invest  in  the  categorization,  thereby 
reducing  the  variability  in  P300  latency. 

We  conclude,  then,  that  the  latency  of  the  late  positive  component  which 
is  associated  with  rare  occurrence?  of  relevant  stimuli  varies  with  cognitive 
processing  time.  These  data  are  consistent  with  the  view  that  the  variable 
latency,  parietal  maximum,  late  positive  waves  are  manifestations  of  the 
activity  of  the  same  intracranial  processor. 
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Figure  Legends 

Figure  1.  Super  impositions  o£  the  average  ERPs  obtained  during  the  four 
different  experimental  conditions  requiring  different  semantic 
categorizations.  At  the  top  are  sample  Cz  waveforms  to  the  rare 
and  frequent  stimuli  from  an  individual  subject.  The  remaining 
waveforms  are  superaverages  across  all  six  subjects  for  the  Fz , Cz 
and  Pz  positions,  respectively.  Only  the  rare  stimuli  (prob.  = .20) 
were  counted.  Each  rare  waveform  consists  of  approximately  20-30 
single  trials. 

Figure  2.  Superimposition  of  ERPs  averaged  across  5 subjects  from  the  4 
different  experimental  conditions  for  the  frontal,  central  and 
parietal  electrode  positions.  Subjects  were  required  to  perform 
a choice  reaction  time  response,  responding  to  frequent  stimuli 
with  one  hand  and  rare  stimuli  with  the  other. 

Figure  3.  Superiraposition  of  the  vertex  ERPs  averaged  across  subjects  for 
3 different  semantic  categorizations  obtained  during  3 different 
response  requirement  regimes.  During  the  collection  of  the  top 
waveforms  subjects  were  asked  to  keep  a running  count  of  the  rare 
stimuli.  The.  middle  waveforms  represent  responses  to  rare  and 
Frequent  stimuli  to  which  subjects  made  choice  RT  responses  under 
orders  to  be  as  accurate  as  possible.  The  bottom  waveforms  were 
obtained  under  similar  choice  RT  response  requirements  with  the 
emphasis  on  speed  rather  than  accuracy. 
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ELECTROCORTICAL  INDICES  OF  HEMISPHERIC  UTILIZATION* 


Donkin,  Kutas,  & McCarthy 


It  13  well  kr,. >wn  that  electroencephalographic  (EEG)  activity 
recorded  from  widely  spaced  scalp  electrodes  is  quite  diverse;  at 
any  ir.stant  the  voltage  at  any  site  may  be  of  a different  ampli- 
tude or  polarity  than  that  recorded  at  other  electrodes.  When  the 
properties  of  the  EEG  as  a time  series  are  evaluated  over  extended  CU 
epochs,  spectra  of  simultaneously  recorded  series  vary  consider- 
ably (Walter,  rhodes.  Brown,  & Adey,  1966)  . This  variability  is 
due  to  the  structural  and  functional  differences  between  brain 
sites  underlying  the  electrodes.  As  brain  tissue  varies  in  its 
activity  patterns  so  do  the  manifestations  of  these  activities  on 
the  scalp. 

The  scalp  distribution  of  EEG  parameters,  estimated  from  appro- 
priately placed  electrodes,  has  long  served  to  support  inferences 
concerning  intracranial  electrophysiological  events.  The  most 
notable  success  and  broadest  application  of  these  inferential 
procedures  has  been  in  clinical  neurology  (Cooper,  Osselton,  & 

Shaw,  1974) . The  scalp  distribution  of  the  EEG  is  widely  used 
in  localizing  epileptic  foci  (Gibbs,  Lennox,  & Gibbs,  1936), 
tumors  (Walter,  1936),  focal  lesions  (Case  & Bucy,  1938),  and 
other  pathologies.  The  relative  success  of  these  procedures  has 
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derived  from  the  fact  that  the  pathology  may  create  localized 
electrical  activity  at  the  scalp  (Cooper  et  al . , 1974).  More 
recent  attempts  to  identify  the  intracranial  locus  of  the  genera- 
tors of  components  of  time-locked,  event- related  potentials 
(ERPs)  have  also  assumed  that  these  generators  represent  spatial- 
ly circumscribed  entities  (Vaughan,  1969,  1974;  Goff,  Matsumiya, 
Allison,  & Goff,  1969)  . In  the  case  cf  events  generated  early 
in  the  afferent  sequence  (events  we  shall  label  exogenous) , such 
inferences  seem  to  be  well  supported  (Goff  et  al.,  1969;  Jewett, 
Romano,  & Williston,  1970) . 

This  review  is  concerned  with  attempts  to  extend  the  use  of 
EEG  scalp  distribution  to  the  assessment  of  the  differential  uti- 
lization of  distinct  cortical  areas  under  different  circum:  ances. 
Our  review  is  restricted  to  studies  that  compare  the  electrical 
activity  recorded  from  homologous  sites  on  the  two  hemispheres. 

The  data  collected  in  these  studies  are  normally  used  to  infer 
which  of  the  two  hemispheres  is  "utilized,"  or  more  actively  en- 
gaged, during  tne  performance  of  one  task  or  another  ( ;f . Gur  & 
Gur,  this  volume) . 

The  iae  of  electrophysio logical  indices  of  hemispheric  utiliza- 
tion ha.j  yrown  with  the  increasing  interest  in  the  study  of  the 
complementary  specialization  of  the  hemispheres.  Much  evidence, 
surveyed  in  other  chapters  of  this  volume,  has  accrued  during  the 
past  two  decades  demonstrating  that  the  two  hemispheres  are  not 
functionally  equivalent.  A grossly  oversimplified  summary  of 
these  data  would  describe  the  left  hemisphere,  in  dextrals,  as 
supporting  verbal,  analytic  processing,  and  the  right  hemisphere 
as  specializing  m spatial,  holistic  processing.  Although  the 
association  between  speech  and  the  left  hemisphere  has  been  known 
since  at  least  the  mid-nineteenth  century  (Broca,  1861)  , the  more 
extensive  knowledge  obtained  during  the  past  two  decades  has  de- 
rived primarily  from  research  on  more  recent  populations  of  com- 
missurotomized  (Gazzaniga,  1970;  Sperry,  1974),  hemispherecto- 
mized  (Smith,  1972) , or  lesioned  patients  (Milner,  1974) . Ex- 
tension of  this  work  depends  on  complementary  and  more  accessible 
sources  of  data.  At  present  the  most  successful  approach  has  been 
through  the  presentation  of  lateralized  sensory  inputs  (Kimura, 
1961,  Bryden,  1965;  see  Berlin;  Springer,  this  volume),  which 
allow,  through  the  use  of  the  standard  techniques  of  experimental 
psychology,  an  evaluation  of  differential  hemispheric  processing 
(Dimond  & Beaumont,  1974) . 

Lateralization  of  sensory  inputs,  however,  is  not  an  easy  pro- 
cedure and  imposes  numerous  restrictions  on  the  range  of  para- 
digms in  which  hemispheric  specialization  can  be  studied.  It  is 
in  this  context  that  the  use  of  electrophysiological  techniques 
is  of  potential  value.  If  indeed  it  is  possible  to  infer  hemi- 
spheric utilization  from  electrophysiological  parameters,  then 
this  convenient,  noninvasive  technique  would  be  available  to 
complement  the  data  obtained  from  commissurotomized  patients. 

This  chapter  is  a review  of  past  attempts  to  realize  the 
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potential  contribution  of  EEG  lateralization  studies  (see  also 
Butler  & Glass,  197^).  As  will  become  apparent,  the  literature 
is  replete  with  uncertain  and  conflicting  results  often  due  to 
inadequate  attention  to  methodology.  The  chapter  concludes  with 
a description  of  work  conducted  in  our  laboratory. 


A SURVEY  OF  CURRENT  STUDIES 

Virtually  all  studies  reviewed  in  this  chapter  have  employed 
the  same  general  paradigm.  The  independent  variable  is  always 
defined  in  terms  of  tasks  assigned  to  the  subject,  some  pre- 
sumably involving  the  right,  others  the  left  hemisphere.  The  de- 
pendent variable  is  always  some  parameter  of  the  scalp-recorded 
EEG  activity. 

The  term  parameter  is  used  in  this  paper  in  the  following 
sense:  The  primary  data  collected  in  all  the  reviewed  studies 

consist  of  the  raw  EEG  recorded  in  either  analog  or  digital  form. 
Any  number  of  functions  can  be  defined  on  these  raw  data.  Such 
statistics  as  the  mean  power,  the  frequency  spectrum,  the  cross- 
correlation function,  or  the  ensemble  average  are  all  functions 
of  the  raw  data,  and  all  estimate  some  parameter  of  the  process 
generating  the  data.  Thus,  investigators  have  wide  freedom  in 
the  choice  of  parameters.  The  specific  choice  they  do  make  is 
determined  by  their  hypotheses  on  the  nature  of  the  EEG  and  EEG- 
behavior  relations.  The  choice,  in  turn,  can  determine  the 
import  of  the  results. 

The  studies  can  be  conveniently  classified  into  two  categories 
according  to  the  dependent  variables  used.  In  one  category  are 
all  studies  that  focus  on  the  "ongoing"  EEG  activity  and  in  which 
frequency-domain  parameters  of  the  EEG  are  estimated  (see 
Gardiner  £ Walter;  Nelsen,  Phillips,  & Goldstein;  Webster,  this 
volume) . Such  parameters  are  usually  measures  of  the  power  or 
amplitude,  of  the  EEG,  integrated  over  some  narrow  or  broad  band- 
width. In  the  second  category  fall  studies  that  analyze  the  EEG 
in  the  time  domain  (see  Anderson;  Stamm,  Rosen,  & Gadotti; 
Thatcher,  this  volume) . These  are  exclusively  concerned  with  the 
waveforms  of  event- related  potentials  (ERPs)  extracted  from  the 
EEG  by  signal  averaging.  Within  these  two  categories  the  studies 
are  classified  in  terms  of  the  independent  variables  used  by  the 
experimenter.  An  overview  of  the  dependent  variables  follows. 

Frequency-Domain  Studies  of  the  EEG 

Many  investigators  have  compared  the  distribution  of  the  spec- 
tral power  of  the  EEG  at  homologous  hemispheric  locations.  Best 
known  are  studies  focusing  on  the  activity  in  the  8-12  Hz  band 
(known  as  alpha ) . The.  interest  in  alpha  activity  derives  from 
the  well-known  inverse  relationship  between  alpha  power  and  men- 
tal effort  (Adrian  & Matthews,  1934;  Berger,  1930).  The  assump- 
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tion  is  made  that  hemispheric  involvement  might  be  indexed  by 
differential  suppression  of  alpha  in  the  two  hemispheres  (Galin 
& Ornstein,  1972).  More  recently,  measures  of  intrahemispheric 
"coupling"  have  been  used  as  indices  of  hemispheric  utilization 
(Callaway  & Harris,  1974).  The  assumption  here  is  that  hemi- 
spheric involvement  leads  to  a greater  degree  of  interaction  be- 
tween different  intrahemispheric  sites,  which  manifests  itself  in 
increased  intrahemispheric  coupling. 

Time-Domain  Studies  of  Event-Related  Potentials  (ERPs) 

With  few  exceptions,  students  of  the  ERP  report  their  results 
in  terns  of  amplitude  or  latency  of  the  entire  ERP  waveform,  or 
its  features.  It  is  important,  however,  to  distinguish  between 
three  classes  of  ERP  /(tudies  in  terms  of  the  components  that  are  S 

ir  fact  analyzed.  The  ERP  consists  of  a sequence  of  positive- 
negative potentials  that  either  precede  or  follow  the  eliciting  ' 
event.  Post  stimulus  activity  tends  to  subside  after  about  500 
nu-:ec,  though  anticipatory  processes  are  known  to  operate  over 
several  seconds.  The  early  poststimulus  comp  'nts  represent 
stages  in  the  afferent  stream  (Buchwald  & Hue  , 1975)  and  are 
often  referred  to  as  exogenous.  Exogenous  components  can  only 
be  recorded  in  association  with  some  sensory  stimulus.  Their 
scalp  distribution  depends  to  a considerable  extent  on  the  modal- 
ity of  the  stimulus  (Goff  et  al.,  1969)  and  their  morphology  on 
the  physical  parameters  of  the  stimulus. 

By  contrast,  the  later  ERP  components,  those  with  latencies 
exceeding  150  msec,  can  be  elicited  in  the  absence  of  a stimulus 
(Sutton,  Tueting,  Zubin,  & John,  1967;  Klinke,  Fruhstorfer,  & 
Finkenzeller , 1968)  , are  relatively  insensitive  to  stimulus  modal- 
ity (Vaughan,  1969) , and  are  enormously  sensitive  to  task  para- 
maters.  We  believe  these  components  are  manifestations  of  corti- 
cal information-processing  activities  engaged  by  task  demands, 
and  we  shall  refer  to  these  as  endogenous  components  (Donchin, 

1975) . 

There  are  two  classes  of  endogenous  components,  those  appear- 
ing before  and  those  appearing  after  the  eliciting  events.  Of 
the  postevent  components,  the  best  known  is  P300  (Sutton,  Brare/,  ft- 
Zubin,  & John,  1965).  The  preevent  components,  such  as  the  Con- 
tingent Negative  Variation  (CNV)  or  the  Readiness  Potential  (RP) , 
are  apparently  related  to  anticipatory  or  preparatory  activities 
(Walter,  Cooper,  Aldridge,  McCallum,  & Winter,  1964;  Kornhuber  & 
Deecke,  1965) . 

The  studies  relating  ERP  components  to  hemispheric  specializa- 
tion have  most  often  been  concerned  with  endogenous  components. 
However,  data  on  the  lateral  distribution  of  exogenous  components 
are  available  and  will  be  reviewed. 


SURVEY  OF  FREQUENCY-DOMAIN  STUDIES 


EEG  Measures  and  Handedness 


This  survey  begins  with  an  analysis  of  the  relationship  of  EEG 
measures  to  manual  preferences,  followed  by  a discussion  of  task- 
induced  changes  in  scalp  distribution  of  EEG  parameters. 

Early  investigators  of  the  EEG,  although  they  noted  occasional 
hemispheric  asymmetries,  stressed  the  similarity  of  EEG  tracings 
recorded  from  the  two  hemispheres  (Adrian  & Matthews,  1934). 

Large  differences  between  homologous  recordings  were  considered 
abnormal  and  were  used  to  localize  focal  disorders  not  character- 
ized by  obvious  dysrhythmias  (Aird  & Bowditch,  1946;  Aird  & 
Zealear,  1951).  Much  evidence,  however,  that  the  alpha  rhythm  is 
rarely  symmetric  in  amplitude  or  in  phase  has  accrued  in  the  past 
few  decades  (Raney,  1939;  Remond,  Leservre,  Joseph,  rjGjjJger,  & 
Lairy,  1969;  Liske,  Hughes,  & Stowe,  1967;  Hoovey,  Heinemann,  & 
Creutzfeldt,  1972)  . These  asymmetries  have  sometimes  been  rela- 
ted to  the  subject's  lateral  preferences.  The  alpha  rhythm  in 
the  dominant  hemisphere  has  been  found  to  be  of  lower  amplitude 
(Comil  & Gastaut,  1947;  Raney,  1937),  but  this  relationship  is 
not  universally  reported  (Butler  & Glass,  1974a;  Glanville  & 
Antonitis,  1955;  Liske  et  al.,  1967;  Provins  & Cunliffe,  1972; 
Remond  et  al.,  1969).  A relationship  between  interhemispheric 
EEG  phase  and  laterality  preferences  has  also  been  reported 
(Giannitrapani , 1967;  Giannitrapani  & Darrow,  1963;  Giannitrapani 
Darrow,  & Sorkin,  1964;  Giannitrapani,  Sorkin,  & Ennenstein, 
r>  1966) . However,  the  relationship  appears  to  be  quite  complex  and 
JL  ^confuS^ptr^  with  the  direction  of  the  phase  asymmetry  changing 
A with  subject  and  state  variables. 

In  part,  the  confusion  derives  from  difficulty  in  defining  and 
validating  a "resting"  state  in  which  to  take  baseline  EEG 
measures.  The  wide  variations  in  measurement  and  analysis  tech- 
niques also  account  for  some  of  the  confusion  in  the  literature. 
Mostly,  however,  the  relationship  between  EEG  laterality  and 
subjects'  lateral  preferences  is  in  fact  quite  complex.  Inter- 
hemispheric alpha  asynchrony  has  been  reported  to  be  more  preva- 
lent in  subjects  with  less  established  lateral  preferences,  s»'ch 
as  the  ambidextrous,  or  in  those  in  whom  lateral  specialization 
may  be  weak,  such  as  stutterers  (Travis  & Knott,  1937;  Lindsley, 
1940).  Similar  asynchronies  have  a] so  been  found  in  children 
with  disordered  verbal -motor  development  (Lairy,  Remond,  Rieger, 

& Leserve,  1969).  Amplitude  asymmetries,  on  the  other  hand,  have 
been  reported  to  be  larger  in  subjects  with  clearly  defined  hand 
preferences  (Lairy  et  al.,  1969;  see  Subirana,  1969).  EEG 
measures  may,  then,  depend  on  the  degree  of  lateral  specializa- 
tion in  individuals  rather  than  on  its  direction  (cf.  Collins, 
this  volume) . Such  considerations  must  be  kept  in  mind  when 
evaluating  the  use  of  EEG  measures  to  index  functional  asymmetry 
in  the  human  brain. 
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Intcthemispheric  EEG  Asymmetries  and  Hemispheric  Specialization 

A number  of  recent  studies  have  claimed  that  interhemispheric 
changes  in  alpha  and  total  EEG  power  accompany  the  performance  of 
functionally  asymmetric  tasks.  Such  investigations  typically ' em- 
ploy a paradigm  in  which  a subject  performs  a task  thought  to 
engage  primarily  one  hemisphere  while  bilateral  samples  of  EEG 
are  taken.  Occipitaj  (Dumas  & Morgan,  1975;  Morgan,  Macdonald,  & 
Hiigard,  1974;  Morgan,  McDonald,  & Macdonald,  1971)  , temporal  and 
parietal  (Doyle,  Ornstein,  & Galin,  1974;  Galin  & Ornstein,  1972; 
McKee,  Humphrey,  & McAdam,  1973)  electrode  placements,  referenced 
to  the  vertex  (C2)  position,  have  been  used.  Intrahemispheric 
bipolar  linkages  have  also  been  employed  (Butler  & Glass,  1974a) . 

Tasks  presumed  to  utilize  the  left  hemisphere  differentially 
have  included  composing  letters  (Galin  & Ornstein,  1972;  Doyle 
et  al.,  1974),  word-search  tasks  (McKee  et  al . , 1973),  mental  ( 
arithmetic  (Morgan  et  al.,  1971,  1974;  Dumas  & Morgan,  1975; 

Butler  & Glass,  1974a;,  and  verbal  listening  (Morgan  et  al.,  1971, 
1974;  Dumas  & Morgan,  1975) . Right-hemisphere  tasks  have  included 
modified  Kohs  Blocks,  Seashore  tonal  memory,  and  drawing  tasks 
(Galin  & Ornstein,  1972;  Doyle  et  al.,  1974).  They  have  also  in- 
cluded spatial  imagery  tasks  (Morgan  et  al.,  1971,  1974;  Dumas  & 
Morgan,  1975)  and  music  listening  tests  (McKee  et  al.,  1973; 

Morgan  et  al.,  1971;  see  Gardiner  & Walter,  this  volume).  In  ad- 
dition, occupation  (artist  versus  engineer)  and  hypnotic  suscepti- 
bility have  been  used  as  independent  variables  (Morgan  et  al., 
1971,  1974;  Dumas  & Morgan,  1975). 

Data  have  been  analyzed  in  many  different  ways.  Often,  inves- 
tigators have  integrated  the  raw  or  filtered  EEG  (Dumas  & Morgan, 
1975;  Galin  & Ornstein,  1972;  McKee  et  al.,  1973;  Morgan  et  al . , 
1971;  Nelsen  et  al.;  Webster,  this  volume).  Others  have  computed 
amplitude  histograms  of  the  EEG  (Butler  & Glass,  1974a)  or  have 
used  conventional  spectral-analysis  techniques  (Doyle  et  al. , 

1974;  Gardiner;  & Walter,  this  volume)  . Despite  the  variety  of 
methods  for  obtaining  estimates  of  power,  most  researchers  have 
then  expressed  their  results  in  terms  of  right/left  or  left/right 
power  ratios  for  homologous  electrode  sites  (Doyle  et  al.,  1974; 
Galin  & Ornstein,  1972;  McKee  et  al.,  1973;  Nelsen  et  al.; 

Webster,  this  volume)  or  as  a laterality  score  expressing  differ- 
ences in  power  as  a function  of  total  power  (Dumas  & Morgan, 

1975;  Morgan  et  al.,  1974;  Gardiner  & Walter,  this  volume). 

Changes  in  these  ratios  are  interpreted  as  evidence  for  differen- 
tial hemispheric  involvement.  For  example,  Galin  and  Ornstein 
(1972)  obtained  the  power  of  the  total  EEG  at  the  right  and  left 
parietal  electrodes.  The  right/left  power  ratio  is  1.15  for  the 
spatial  Kohs  Blocks  task  and  1.30  for  the  verbal  letter-writing 
task.  The  increase  in  the  power  in  the  right  hemisphere  rela- 
tive to  the  left  hemisphere  for  the  letter-writing  task  is  pre- 
sumed to  reflect  the  greater  involvement  of  the  left  hemisphere 
in  that  task  (recall  that  increased  power  implies  increased  alpha 
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activity  and  by  inference  implies  a lesser  degree  o£  hemispheric 
involvement) . Similar  results  were  obtained  in  studies  of  acti- 
vity in  the  alpha  band  (Dumas  & Morgan.  ±975;  McKee  et  al.,  1973; 
Morgan  et  al.,  1971).  Butler  and  Glass  (1974a)  found  left- 
hemisphere  suppression  of  alpha  during  mental  arithmetic  but  only 
in  their  dextral  subjects;  unfortunately,  no  right-hemisphere 
tasks  were  used  for  comparison.  A more  sophisticated  frequency 
analysis  (Doyle  et  al . , 1974)  revealed  that  the  main  locus  of 
task-dependent  distributional  changes  occurs  in  the  alpha  band. 
They  reported  minor  interhemispheric  differences  in  the  beta  and 
theta  bands  and  no  changes  in  the  delta  band  (cf.  Gardiner  & 
Walter,  this  volume) . 

Although  these  studies  may  indicate  that  there  are  small  task- 
depencent  changes  in  the  EEG  spectrum,  the  implication  that  se- 
lective suppression  in  the  dominant  hemisphere  for  the  task  iy  the 
cause  of  the  ratio  changes  cannot  be  supported  on  the  evidence  / 
presented.  It  is  not  possible  to  tell  if  a ratio  has  been  modi- 
fied by  changing  tr.e  numerator,  the  denominator,  or  both  when  only 
the  ratio  figure  is  presented.  Note  also  that  in  most  of  these 
studies  the  experimentally  induced  differences  are  superimposed 
upon  a constant  i ight/left  hemisphere  asymmetry  and  do  not  repre- 
sent shifts  from  a symmetric  baseline. 

Intrahemispheric  EEG  Measures  and  Hemispheric  Specialization 

To  date,  only  one  study  has  employed  the  intrahemispheric 
coupling  approach  to  the  study  of  hemispheric  specialization  (see 
Livanov,  Gavrilova,  & Aslanov,  1964,  1973  for  related  work). 
Callaway  and  Harris  (1974)  reported  that  appositional  or  spatial 
analysis  of  visual  stimuli  increases  the  relative  amount  of  pos- 
terior right  hemisphere  coupling,  and  propositional  examination 
of  visual  material  (such  as  reading)  increases  posterior  left 
hemisphere  coupling.  As  yet  unpublished  data  from  the  same  labor- 
atory tend  to  confirm  and  extend  these  observations  (Callaway, 
personal  communication' . 

SURVEY  OF  TIME-DOMAIN  STUDIES 

In  this  section  we  report  on  studies  of  event-related  poten- 
tials (ERPs)  extracted  by  signal  averaging  from  the  ongoing  EEG. 
All  the  studies  reviewed  compared  ERPs  recorded  at  homologous 
hemispheric  sites.  As  in  the  frequency-domain  studies  discussed 
in  the  previous  section,  the  ERP  investigators  endeavored  to 
demonstrate  that  task  variables  determine  the  relative  amplitude 
of  ERPs  over  the  hemispheres.  These  differences  were  sometimes 
evaluated  in  terms  of  subjects'  handedness  and  cerebral  dominance. 

Studies  of  Exogenous  Components 


Very  few  of  the  studies  reviewed  in  this  section  were  motivated 
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by  an  interest  in  hemispheric  specialization.  Rather,  the  in- 
vestigators were  seeking  information  on  the  scalp  distribution  of 
sensory  evoked  potentials.  Their  goal  has  usually  been  the  elu- 
cidation of  the  intracranial  sources  of  these  exogenous  compon- 
ents. Yet  data  were  often  collected  from  homologous  hemispheric 
sites.  These  provide  valuable  baseline  data  on  hemispheric  asym- 
metries. Clearly,  if  ERPs  associated  with  a given  modality  are 
asymmetric  in  the  absence  of  any  task  inducement  for  such  later- 
alization, such  biases  must  be  considered  when  testing  hypotheses 
about  hemispheric  specialization.  The  results  on  hand,  however, 
are  equivocal.  It  would  be  difficult  to  develop,  on  the  basis  of 
the  available  literature,  a specification  of  the  lateralization 
biases  for  different  stimulus  modalities.  & 
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Somatosensory  ERPs 

I 

The  data  are  scant.  The  consensus  seems  to  be  that  the  largest 
somatosensory  responses  are  recorded  from  the  scalp  overlying 
the  parietal  cortex  contralateral  to  the  stimulation  site  (Calmes 
& Cracco,  1971;  (ioff,  Rosner,  & Allison,  1962;  Manil,  Desmedt, 
Debecker,  & Chorazyna) . 

A 

Audi tory 

Considerable  -ontroversy  exists  regarding  the  lateral  distribu- 
tion of  the  various  components  of  auditory  ERPs.  The  maximal 
contralateral  projection  to  the  auditory  cortex  as  well  as  the 
oft  observed  dominance  of  one  ear  over  the  other  in  dichotic- 
listenmg  tasks  (see  Anderson;  Berlin;  Springer,  this  volume) 
suggest  that,  at  least  under  certain  conditions,  different  audi- 
tory ERPs  shou’ d be  recorded  over  the  two  hemispheres.  Most  in- 
vestigators concur  that  right-  and  left-ear  stimulation  generate 
different  scalp  distributions,  but  there  is  no  agreement:  on  the 
specifics  of  these  distributions.  Most  reports  maintain  that 
there  is  a general  predominance  of  the  contralateral  response; 
some  find  differences  in  terms  of  a shorter  latency  response 
(Majkowski,  Bochenek,  Bochenek,  Knapik-Fijalkowska,  & Kopec, 

1971),  others  in  terms  of  a larger  amplitude  response  (Andreassi, 
De  Simone,  Friend,  & Grota,  1975;  Peronnet,  Michel,  Echallier,  & 
Girod,  1974;  Price,  Rosenblut,  Goldstein,  & Shepherd,  1966;  Ruhm, 
1971;  Vaughan  & Ritter,  1970),  and  a few  in  terms  of  both  these 
measures  (Butler,  Keidel,  £ Spreng,  1969).  Vaughan  and  Ritter 
(1970)  reported  a small  but  consistent  tendency  for  larger  re- 
sponses to  appear  cor cralateral  to  the  stimulated  ear,  but  the 
effect  was  greater  over  the  left  hemisphere  in  response  to  right- 
ear  stimulation.  Other  researchers  (Peronnet  et  al . , 1974;  Ruhm, 
1971)  report  that  the  right-hemisphere  response  is  consistently 
larger  only  for  left-ear  stimulation.  Peters  and  Mendel  (1974) 
failed  to  find  such  a consistent  relationship  between  the  ear 
stimu'ated  and  the  latency  and  amplitude  of  early  (less  than  70 
msec)  ERP  components.  Given  these  contradictions,  there  seems  to 


be  little  basis  yet  in  trying  to  relate  the  lateral  asymmetry  of 
auditory  ERPs  to  handedness,  cerebral  dominance,  or  ear  perfer- 
ence . 

Visual  ERPs 

Similar  inconsistencies  appear  in  studies  of  the  laterality  of 
visual  ERPs.  Studies  of  interhemispheric  differences  in  visual 
ERPs  have  been  particularly  hampered  by  the  need  to  assure  that 
the  ERP  elicited  by  stimulation  of  a retinal  half-field  is  gener- 
ated entirely  within  a single  hemisphere.  Whereas  it  has  been 
well  established  that  stimulation  of  different  visual  half-fields 
elicits  different  scalp  distributions  (see  KacKay,  1969;  Regan, 
1972) , the  comparison  of  the  hemispheric  distributions  of  visual 
ERPs  is  not  as  straightforward.  Several  investigators  (Kooi, 
Guverer,  & Bagchi,  1965;  Vaughan,  Katzman,  & Taylo§^~1963; 
Harmony , Ricardo.  Fernandez,  & Valdes,  1973;  have  reported  that 
visual  ERPs  recorded  over  homologous  regions  in  normal  subjects 
are  symmetric.  Other  researchers,  however,  have  maintained  that 
visual  ERPs  recorded  from  the  right  hemisphere  are  larger  than 
those  recorded  from  the  left  hemisphere  (Perry  K Childers,  1969; 
Rhodes,  Dustman,  f,  Beck,  1969;  Rhodes,  Obitz,  & Creel,  1975; 
Richlm,  Weisinger,  Weinstein,  Giannini,  & Morganstern,  1971; 
Schenkenberg  & Dustman,  1970;  Butler  & Glass,  1972).  A more  re- 
cent report  has  indicated  that  retinal  site  of  stimulation  may 
induce  latency  asymmetries  in  ERP  components  (Andreassi,  Okamura, 

& Stern,  1975> 

The  few  inv. ligations  (Culver,  Tanley,  & Eason,  1970;  Eason, 
Groves,  White,  & Oden,  1967;  Gott  & Boyarsky,  1972)  concerned 
with  the  relations  between  handedness,  cerebral  dominance,  eye 
dominance,  and  visual  ERPs  have  yielded  ambiguous  results.  Eason 
et  al.  (1967)  originally  reported  that  the  visual  ERPs  were  larger 
over  the  right  than  the  left  hemisphere  for  left-handers  only. 
However,  a subsequent  report  from  the  same  laboratory  (Culver  et 
al.,  1970)  failed  to  confirm  this  finding.  Rather,  Culver  et  al. 
reported  that  visual  ERP  amplitudes  were  larger  over  the  right 
than  the  left  occipital  lobe  in  response  to  left-  but  not  right- 
visual— field  stimulation.  This  failure  to  replicate  previous  re- 
sults is  attributed  by  Culver  to  confounding  effects  of  sex  and 
handedness  (cf.  Gur  S Gur,  this  volume) . Gott  and  Boyarsky 
(1972)  reported  that  left-handers  produced  larger  visual  ERPs 
over  the  left  hemisphere  and  that  direct  stimulation  of  the  domi- 
nant hemisphere  (generally  right  for  sinistrals  and  left  for  dex- 
trals)  elicited  ERPs  with  shorter  latency  than  those  elicited  by 
stimulation  of  the  opposite,  nondominant  hemisphere. 

A .report  by  Galin  and  Ellis  (1975)  indicates  that  the  symmetry 
of  the  visual  ERP  is  influenced  by  the  spectral  characteristics 
of  the  EEG  at  the  time  of  stimulus  presentation.  They  found  that 
ERPs  elicited  during  tasks  inducing  hemispheric  asymmetries  in 
alpha  power  were  also  asymmetric  as  determined  by  measures  of 


. Peak- to- trough  amplitude  and  power.  Such  results  are  provocative 
and  suggest  that  baseline  symmetry  in  ERPs  may  depend  on  varia- 
bility in  ongoing  EEG  activity,  which  may  in  turn  depend  on 
subject  state  variables. 

Studies  of  Endogenous  Components 

Asymmetries  in  Movement-Related  Potentials 

The  most  consistent  observations  of  functionally  interpretable 
lateralization  have  been  obtained  for  slow  potentials  that  are 
apparently  associated  with  the  control  or  the  monitoring  of  move- 
ment. 

1.  Readiness  Potential.  There  is  now  a general  consensus  that 
the  sjow  negative  shift  preceding  volui^tjjry  arm  and  hand  movements 
variously  called  the  readiness  potential  (RP) , Bereitschaftspoten- 
tial  (BSP),  or  Ni  of  the  motor  potential  (MP) , is  a few  micro- 
volts larger  over  the  pre-Rolandic  area  on  the  scalp  contralateral 
to  the  responding  limb  (Gilden,  Vaughan,  & Costa,  1966;  Kutas  & 
Donchin , 1974a,  1974b;  Vaughan,  Costa,  & Ritter,  1968).  Kornhuber 
and  his  co-vorker3  (Oeecke,  Scheid,  & Kornhuber,  1969;  Kornhuber 
& Deecice,  19*5!  maintain  that  this  contralateral  dominance  is 
restricted  to  the  abrupt  negativity  just  preceding  the  movement, 
but  Kutas  and  txmehin  (1974a,  1974b)  demonstrated  that  the  hemi- 
sp^^riC  asymmetry  can  be  observed  hundreds  of  milliseconds  prior 
to  the  response.  The  exact  timing  of  the  components  of  the  motor 
potential  immediately  preceding  the  movement  is,  however,  contro- 
versial. Gerbrandt,  Goff,  and  Smith  (1973)  claimed  that  this 
negativity  occurs  after  movement;  Vaughan  et  al.  (1968)  found 
that  the  RP  has  a somatotopic  distribution  and  clearly  occurs 
prior  to  movement.  Two  reports  (Gerbrandt  et  al.,  1973;  Wilke  & 
Lansing,  1973)  reject  the  notion  that  these  premovement  poten- 
tials are  associated  with  a motor  command  and  claim  that  the 
potentials  are  manifestations  of  the  activity  of  postresponse 
proprioceptive  mechanisms.  However  this  issue  is  resolved,  there 
is  no  question  that  Nl  precedes  the  movement.  Thus,  our  demon- 
stration that  the  Nl  component  of  the  MP  is  larger  contralateral 
to  the  responding  hand  is  a clear  illustration  of  the  manner  in 
which  EEG  scalp  distributions  reflect  hemispheric  utilization 
(Kutas  & Donchin,  1974a) . 

The  absolute  amplitude  of  the  motor  potentials  depends  on  a 
number  of  variables  such  as  force  (Kutas  & Donchin,  1974a,  1974b; 
Wilke  & Lansing,  1973)  and  motivation  (McAdam  & Seales,  1969). 

The  relevant  parameters  affecting  the  degree  of  Nl  asymmetry, 
other  than  subject  handedness  and  responding  hand,  have  yet  to  be 
determined.  A promising  source  of  data  is  intracerebral  record- 
ing from  human  patients  (see  McCallum  & Papakostopoulos,  1974) . 
These  preliminary  data  suggest  that  subtle  changes  in  timing  and 
asymmetry  of  the  RP  may  be  obscured  in  scalp  recordings. 


2.  Response  Variables  and  the  Contingent  Negative  Variation. 

Many  investigators  have  noted  the  similarity  of  the  CNV  and  Nl.  The 
suggestion  that  these  two  waveforms  might  represent  identical  pro- 
cesses is  derived  partly  from  the  fact  that  most  CNV  studies  have 
required  a motor  response  to  the  imperative  stimulus.  Early  map- 
ping studies  (Cohen,  1969;  Low,  Borda,  Frost,  & Kellaway,  1966) 
demonstrated  that  the  CNV  preceding  a motor  response  in  an  RT 
paradigm  is  symmetrically  distributed  over  the  two  hemispheres. 
Within  the  past  few  years  it  has  been  asserted  that  slightly  lar- 
ger CNVs  appear  over  the  hemisphere  contralateral  to  the  hand 
used  for  the  response  (Syndulko,  1969,  1972;  Otto  & Leifer,  1973). 
Syndulko  (1972)  reported  that  this  response-related  lateral  asym- 
metry was  specific  to  central  as  opposed  to  frontal,  parietal,  or 
occipital  locations  and  developed  only  preceding  unimanual  re- 
sponse preparation.  Otto  and  Leifer  (1973)  , on  the  other  hand, 
noted  that  a CNV  laterality  was  statistically  significant  only 
when  the  data  were  pooled  across  their  response  and  feedback  con- 
ditions. It  has  been  well  established  that  CNVs  can  be  generated, 
in  the  absence  of  a motor  response  (Cohen  & Walter,  1966;  Donchin, 
Gerbraodt,  Leifer,  & Tucker,  1972;  Donchin,  Kubovy,  Kutas, 

Johnson,  6 Herning,  1973;  Low  et  al. , 1966)  and  must  therefore 
represent  more  than  mere  motor  preparation.  The  weak  laterality 
of  the  slow  negative  wave  in  response-oriented  CNV  paradigms  sug- 
gests that  the  negativity  is  multiply  determined.  It  is  con- 
ceivable that  both  a response-related  lateralized  negativity  and 
a "cognitive"  bilateral  negativity  are  generated  in  the  classical 
CNV  paradigms.  Such  a two-component  hypothesis  has  been  suggested 
by  Hillyard  (197J;  see  also  Gazzan.tga  & Hillyard,  1973)  . In  one 
of  our  studies  (Donchin,  Kutas,  & McCarthy,  1974,  discussed  in 
more  detail  later  in  this  chapter) , we  were  able  to  elicit  in 
rapid  succession  a latev  ized  motor  potential  followed  by  a bi- 
lateral anticipatory  por.ential.  (See  also  Stamm  et  al.,  this 
volume . ) 

ERP  asymmetries  Associated  with  Cognitive  Functions 

Very  few  studies  have  been  designed  specifically  to  seek  con- 
comitants of  lateralized  perceptual  or  cognitive  functioning  in 
such  endogenous  ERP  components  as  P300  and  CNV.  It  has  been 
claimed  that  the  lateral  distribution  of  the  CNV  changes  with 
task  demands,  but  there  is  no  consensus  as  to  whether  the  engaged 
hemisphere  has  the  larger  or  smaller  CNV.  Marsh  and  Thompson 
(1973)  originally  observed  a symmetric  Cjfv  during  preparation  for 
a visuospatial  discrimination,  presumably  a right-hemisphere  task. 
When  this  nonverbal  task  was  randomly  interspersed  among  verbal 
stimuli  and  required  a pointing  (rather  than  a verbal)  response, 
the  hemisphere  primary  for  that  task  had  the  smaller  amplitude 
CNV.  In  contrast  Butler  and  Glass  (1974b)  found  a larger  CNV 
over  the  dominant  hemisphere  during  a warning  interval  in  which 
subjects  awaited  numerical  information.  The  CNV  asymmetries  took 
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the  form  of  an  earlier  onset  and  greater  amplitude  potential  over 
tha  hemisphere  contralateral  to  the  preferred  hand.  Unfortu- 
nately, they  had  only  one  left-hander  against  whom  to  compare  the 
data  of  their  right-handed  subjects.,  The1  fact  that  in  their 
"control"  condition  large  asymmetric  CNVs  were  also  generated 
makes  the  results  still  more  difficult  to  interpret.  Care  must 
in  general  be  exercised  in  the  choice  of  stimulus  modalities  and 
response  requirements  in  designing  such  studies,  as  CNVs  in  dif- 
ferent paradigms  have  distinct  anterior-posterior  scalp  distribu- 
tions, a central  dominant  CNV  preceding  tasks  requiring  motor 
readiness  (Jarvilehto  £ Fruhstorfer,  1970;  Syndulko,  1972;  Poon, 
Thompson,  Williams,  £ Marsh,  1975),  a frontal  dominant  CNV 
accompanying  auditory  discrimination  (Jarvilehto  £ Fruhstorfer, 
1970;  Syndulko,  1972),  and  a parietal  dominant  CNV  accompanying 
similar  visual  tasks  (Cohen,  1973;  Syndulko,  1972) . No  definite 
conclusions  can  be  drawn  at  this  time  as  to  how  CNV  distribution 
is  related  to  cerebral  dominance. 

In  s-mmary,  a start  has  been  made  toward  using  ERP  methods  to 
investigate  differences  between  the  dominant  and  nondominant 
hemispheres,  but  progress  has  been  slow  and  somewhat  hampered 
by  inadequate  experimental  design  and  analysis  procedures. 

ERP  Aa^ntnetries  in  Linguistic  Processing 

In  this  sect  u n we  will  review  studies  of  the  ERP  relating 
hemispheric  asymmetries  to  linguistic  functions.  Given  the 
abundant  evidence  that  verbal  information  is  processed  more  ef- 
ficiently by  the  left  hemisphere,  the  search  for  ERP  correlates 
of  linguistic  processing  has  become  increasingly  energetic  in 
the  past  decade. 

2.  Asymmetries  in  Language  Reception:  Visual  Modality.  Re- 

sults based  on  multiple  electrode  recordings  have  led  to  the 
claim  that  asymmetric  cerebral  functions  underlying  evaluation  of 
visual  stimuli  are  reflected  in  the  ERP  (see  Thatcher,  this 
volume) . Buchsbaum  and  Fedio  (1969)  have  presented  different 
visual  stimuli  (words,  dots,  or  designs)  in  a random  sequence. 
They  reported  that  ERPs  elicited  by  words  can  be  differentiated 
from  ERPs  elicited  by  nonlinguistic,  patterned  stimuli.  They 
also  claimed  that  foveally  presented  verbal  and  nonverbal  stimuli 
elicit  waveforms  that  are  more  differentiable  when  recorded  at 
the  left  than  when  recorded  at  the  right  hemisphere.  They  have 
reported  similar  results  in  a study  investigating  interhemi- 
spheric  differences  in  ERPs  related  to  the  perception  of  verbal 
and  nonverbal  stimuli  flashed  to  the  left  or  right  visual  fields 
(Buchsbaum  £ Fedio,  1970). 

Marsh  and  Thompson  (1973)  investigated  the  possibility  that 
verbal  sets  would  lead  to  differential  right-  and  left-hemisphere 
amplitudes  of  slow  negative  shifts  by  asking  subjects  t:o  identify 
their  stimuli  verbally.  During  the  anticipation  of  flashed  words, 
symmetric  CNVs  were  generated  at  the  midtemporal  and  angular 
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gyrus  placements.  Preliminary  data  obtained  when  the  two  experi- 
mental conditions  (verbal  and  nonverbal)  were  intermixed  yielded 
asymmetries  in  the  temporal  and  parietal  sites.  Other  studies 
dealing  with  visually  presented  words  have  noted  a striking  lack 
of  hemispheric  asymmetry.  Shelburne  (1972,  1973)  recorded  visual 
evoked  potentials  to  th.:ee  individually  flashed  letters  that  com- 
prised either  a real  or  a nonsense  word.  A comparison  of  the 
responses  elicited  by  these  two  different  linguistic  stimuli  re- 
vealed no  consistent  differences  between  the  visual  ERPs  to  the 
words  and  to  the  nonsense  syllables  in  either  the  left  or  right, 
parietal  or  occipital  leads.  In  a similar  paradigm,  in  which 
subjects  were  asked  to  report  the  key  word  in  a visually  pre- 
sented sentence,  no  asymmetries  in  any  of  the  components  of  the 
ERPs  associated  with  words  could  be  seen  (Friedman,  Simson, 
Ritter,  £ Rapin,  1975).  Friedman  and  his  associates  present  a 
trenchant  critique  of  tne  studies  reviewed  in  this  section. 

2.  Asgnwnetr ie>s  in  Language  Reception:  Auditory  Modality.  Al- 

though still  contradictory  and  inconsistent,  somewhat  more  pro- 
mising results  have  been  obtained  with  auditory  stimuli  (Brown, 
Karsh,  S Smith,  1973;  Cohn,  1971;  Matsumiya,  Tagliasco,  Lombroso, 
& GoodgLass,  1972;  Maltese,  Freeman,  & Palermo,  1975;  Morrell  & 
,Xalamy.  1971;  Neville,  1973;  Teyler,  Harrison,  Roemer,  & 

Thompson,  197J;  Wood,  Goff,  & Day,  1971;  Anderson,  this  volume). 

A number  of  studies  have  in  fact  supported  the  view  that  linguis- 
tic analysis  occurs  primarily  in  the  left  hemisphere.  In  a 
brief  L-eport,  Cohn  (1971)  tells  of  a prominent,  positive-going 
peak  with  a 14-msec  latency  elicited  in  the  right  hemisphere  by 
click  stimuli  but  not  by  single-syllable  words.  Morrell  and 
Salamy  (1971)  found  the  N100  component  elicited  by  nonsense  words 
larger  over  the  left  than  the  right  temporoparietal  area.  It  is 
difficult  to  interpret  their  results,  as  they  failed  to  use  a 
nonlanguage  control.  Matsumiya  et  al.  (1972)  reported  a hemi- 
spheric asymmetry  in  a "W-wave"  (a  positive  response  recorded  bi- 
polar ly,  peaking  at  100  msec)  elicited  by  real  words  and  environ- 
mental sounds.  They  ascribe  this  hemispheric  asymmetry  to  the 
significance  of  the  auditory  stimuli  for  the  subject  rather  than 
to  the  linguistic  features  of  the  stimulus.  Wood  et  al.  (1971) 
reported  differences  in  the  ERPs  recorded  over  the  left  hemi- 
sphere that  appeared  in  the  N100-P200  component,  depending  on 
whether  tne  subject  was  required  to  perform  a linguistic  or  an 
acoustic  analysis  of  the  stimulus  (cf . Anderson,  this  volume) . 
Molfese  et  al.  (1975)  found  a similar  enhancement  in  the  ampli- 
tude of  the  N1-P2  component  of  the  ERP  in  the  left  relative  to 
the  right  hemisphere  for  speech  stimuli,  even  when  the  subject's 
task  was  merely  to  listen.  On  the  other  hand,  nonspeech  acoustic 
stimuli  were  found  to  produce  larger  amplitude  responses  in  the 
right  hemisphere.  Although  Molfese  et  al . found  asymmetries  in 
the  auditory  ERPs  from  infants,  children,  and  adults,  they  noted 
that  the  lateral  differences  to  both  types  of  stimuli  decreased 
with  age.  Neville  (1974)  reported  lateral  ERP  amplitude  and 
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latency  differences  elicited  by  digits  but  not  by  clicks  a 
dichotic  listening  paradigm. 

Several  investigators  have  attempted  to  evaluate  the  influence 
of  linguistic  meaning  on  scalp  ERPs.  Teyler  et  al.  (1973)  re- 
ported that  different  ERPs  could  be  recorded  from  the  same  elec- 
trode site  to  the  same  click  stimulus  depending  on  thi_  meaning 
of  the  verbal  context  (noun-verb)  to  which  the  stimulus  was 
temporally  related.  Linguistic  stimuli  elicited  responses  of 
greater  magnitude  in  the  dominant  hemisphere.  In  a similar  study. 
Brown  et  al.  (1973)  recorded  ERPs  to  the  actual  words  rather  than 
to  coincidental  clicks.  The  words  they  used  were  ambiguous  and 
were  disambiguated  by  their  context.  They  reported  -.1)  that  the 
waveform  of  the  ERPs  evoked  by  a particular  word  differed  accord- 
ing to  its  contextual  meaning  and  (2)  that  these  differences 
were  significantly  greater  for  left-  thar,  for  right-hemisphere 
loci.  It  seems  then  that  different  investigators  find  in  a ( 

variety  of  ERP  parameters  greeter  variability  over  the  left  than 
over  the  right  hemisphere. 

3.  Slow-Potercial  Asymmetries  Preceding  Language  Production. 
Whereas  the  studies  just  reviewed  were  primarily  concerned  with 
demonstrating  different  degrees  of  hemispheric  asymmetry  in  re- 
sponse to  verbal  and  nonverbal  stimuli,  others  have  tried  to 
find  the  ERP  concomitants  of  speech  production.  McAdam  and 
Whitaker  (1971)  ooserved  a small  increase  in  the  negativity  over 
Broca* s area  (in  the  left  hemisphere)  preceding  spontaneous 
spoken  words  but  not  preceding  simple  oral  gestures.  This  report, 
however,  has  been  attacked  by  Morrell  and  Huntington  (1971)  on 
several  grounds.  They  questioned  McAdam  and  Whitaker's  pro- 
cedures, analyses,  and  conclusions.  Morrell  and  Huntington  claim 
that  when  movement  artifacts  were  monitored  and  the  same  measure- 
ments were  made  for  all  waveforms,  nc  hemispheric  asymmetries 
consistent  with  localization  over  Broca's  area  could  be  found 
(cf.  Anderson,  this  volume).  McAdam  and  Whitaker's  findings,  on 
the  other  hand,  have  been  essentially  confirmed  by  Low,  Wada,  and 
Fox  (1974,  1976)  who,  in  addition,  found  a significant  correla- 
tion between  hemispheric  dominance  as  determined  by  the  Wada 
sodium  amytal  test  and  dominance  derived  from  the  relative  CNV 
amplitudes  in  the  left  and  right  motor  speech  area.  Zimmerman 
and  Knott  (1974)  applied  similar  procedures  to  an  investigation 
of  the  physiological  basis  of  stuttering.  A comparison  of  CNVs 
in  stutterers  and  normal  speakers  during  speech  and  nonspeech 
tasks  revealed  that  only  22%  of  the  stutterers  showed  a left- 
greater-than-right  asymmetry  as  opposed  to  80%  of  the  normal 
speakers.  Thus,  although  a substantial  amount  of  clinical  data 
supports  the  theory  of  left-hemisphere  superiority  in  language 
reception  and  production,  the  ERP  data  regarding  this  functional 
asymmetry  are  far  from  consistent.  The  methodological  and  sta- 
tistical shortcomings  existing  in  many  of  the  studies  cited 
render  any  decision  about  the  efficacy  of  ERPs  as  indices  of 
linguistic  processing  inconclusive. 


meth<~do logical  critique  of  lateralization  studies 


One  need  not  be  overly  critical  to  conclude  from  the  preceding 
review  that  it  is  premature  to  advocate  the  use  of  the  EEC  and 
ERP  parameters  as  indices  of  hemispheric  utilization;  similar 
conclusions  have  recently  been  adumbrated  by  Friedman  et  al. 
(1975)  and  by  Galambos,  Benson,  Smith,  Schulman-Galambos , and 
Osier  (1975).  Yet,  within  the  welter  of  conflicting  claims  and 
apparent  inconsistencies  there  is  a thread  of  positive  results 
that  indicates  the  promise  of  the  approach.  The  expectation  that 
differential  hemispheric  utilization  will  manifest  itself  in 
scalp-recorded  electrical  activity  is  plausible.  Wh£«f  then  is 
the  literature  so  confused?  There  are  two  related  answers.  The 
functional  significance  of  electrocortical  "macrc"  potentials  is, 
as  yet,  obscure.  Although  the  evidence  is  strong  that  the  EEG  is 
a manifestation  of  "real"  brain  events,  neither  its  general  role 
nor  the  role  of  its  many  different  parameters  has  been  clarified.' 
It  is,  therefore,  the  case  that  the  st  -dies  reviewed  earlier,  as 
well  d*  our  own  studies,  are  not  guided  by  a specific  theoretical 
view  of  the  EEG.  On  the  whole,  investigators  do  not  have 
a prion  expectations  regarding  the  direction  of  the  differences 
they  Will  observe.  Until  neurophysiologists  supply  a coherent 
view  of  the  EEG,  in  empirical  approach  i ust  predominate  in  this 
research.  As  long  as  it  does,  a measure  of  uncertainty  will 
naturally  pervade  the  literature. 

The  uncertainties  and  confusions  deriving  from  our  meager  un- 
derstanding of  the  EEG  are  exacerbated  by  inattention  to  proper 
methodology.  Even  within  the  constraints  discussed  previously, 
the  issues  could  be  clarified,  were  investigators  to  attend  more 
carefully  to  methodological  considerations.  The  following  is  a 
review  of  some  of  the  more  important  points  that  should  be  con- 
sidered in  designing,  conducting,  and  analyzing  experiments  in 
this  field. 

It  would  help  to  d/scuss  first  the  formal  structure  of  the  ex- 
periments reviewed  an<3  to  identify  within  that  structure  the 
major  loci  of  methodological  difficulty.  The  dependent  variable 
in  the  reviewed  literature  is  always  the  difference  between  a 
pair  of  values  of  some  EEG  or  ERP  parameter  recorded  at  hotanlo- 
gous  bilateral  sites.  The  independent  variables  are  mr^c  often 
dis^uca  -d  m terms  of  the  tasks  the  investigator  has  imposed  on 
Lhj  subjt ct.,  A class  of  tasks  that  is  presumed,  on  previous 
data  or  i lenitive  grounds,  co  engage  differentially  one  hemi- 
sphere or  Ve  other,  is  usually  selected.  The  experimental  con- 
clusions can  invariably  be  stated  as  a functional  relationship 
between  the  sign  and  magnitude  of  the  EEG  parameter  and  task 
variables,  which  are  in  turn  presumed  to  reflect  basic  features 
of  human  information  processing. 

Assume,  for  the  sake  of  argument,  that  there  really  is  a dif- 
ference of  the  type  sought.  If  the  various  experimental  state- 
ments are  in  conflict  or  are  not  very  convincing,  any  or  all  of 
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the  following  reasons  might  be  the  cause: 

1.  The  experimental  design  is  not  sufficiently  sensitive  to 
allow  detection  of  the  differences  or  is  inadequate  to 
support  the  conclusions. 

2.  The  tasks  assigned  the  subject  ma-;  not  in  fact  differ- 
entially engage  the  hemispheres. 

3.  The  effects  are  range-restricted  and  the  values  of  the 
independent  variables  are  out  of  the  relevant  range. 

4.  Subject  individual-difference  variables  are  not  considered. 

5.  The  parameters  of  the  EEG  used  as  dependent  variables  were 
unwisely  selected. 

6.  The  measurement  techniques  used  to  obtain  the  parameters 
are  inappropriate. 

7.  The  data  are  improperly  quantified  and  were  inappropri- 
ately or  insufficiently  analysed. 

Design  and  analysis  problems  in  recording  scalp  electrical 
activity  in  humans  have  teen  the  topic  of  many  comprehensive  re- 
views (Donchin  1J73,  1975;  Donchin  & Lindsley,  1969;  Thompson  & 
Patterson,  1974)  . Our  discussion  is  therefore  limited  to  those 
problems  specific  to  the  use  of  the  distribution  of  scalp  poten- 
tials as  an  index  of  hemispheric  functioning. 

SURVEY  OF  METHCJC LOGICAL  PROBLEMS 

Design  Problems 

If  one  point  emerges  with  clarity  from  the  studies  reviewed, 
it  is  this:  If  "here  are  any  differences  between  the  electro- 
cortical  activity  of  the  two  hemispheres,  they  will  be  minute. 

This  implies  that  to  reveal  lateral  dominance  for  study  one  must 
use  techniques  with  the  required  high  resolving  power.  The 
subtlety  of  the  differences  sought  dictates  the  use  of  experimen- 
tal designs  of  great  sensitivity.  Real  but  minute  differences 
should  not  be  ignored  (type  II  errors) , but  at  the  same  time 
artifactual  sources  of  interhemispheric  differences  that  may 
lead  to  type  I errors  should  be  avoided.  The  designs  should  mini- 
mize the  chances  of  both  types  of  errors.  All  too  often  the 
designs  used  in  the  reviewed  studies  were  far  from  optimal. 

In  virtually  all  the  reviewed  studies,  data  were  obtained  from 
all  subjects  under  all  experimental  conditions.  For  example,  all 
subjects  were  challenged  with  spatial  and  verbal  tasks.  The  in- 
vestigators than  chose  between  pooling  the  subjects'  data,  com- 
paring group  means,  or  using  a repeated  measurements  design 
(with  each  subject  serving  as  his  own  control) . The  last  pro- 
cedure is  customarily  preferred  when  large  individual  differ- 
ences are  expected  in  the  data.  The  increased  power  of  within- 
group  designs  aids  in  uncovering  small-magnitude  changes  that 
would  otherwise  be  obscured  in  between-group  variance.  Repeated- 
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measures  designs  are  common  in  ERP  work,  but  many  of  the  widely 
cited  studies  of  frequency-domain  parameters  contain  data  that 
were  averaged  over  groups  of  subjects. 

It  is,  of  course,  crucial  to  ensure  that  all  experimental  de- 
signs include  proper  control  procedures.  When  lateral  asymmetry 
is  attributed  to  the  specific  effects  of  a task,  it  is  incumbent 
upon  the  experimenter  to  demonstrate  that  the  same  parameter, 
when  estimated  during  some  neutral  task,  does  not  display  a simi- 
lar asymmetry  (see  Thatcher,  this  volume) . At  the  least,  the 
investigator  should  demonstrate  that  the  lateral  asymmetry  can  be 
reversed  or  modulated  with  appropriate  changes  in  the  task 
("double  dissociation");  thus  investigators  should  include  tasks 
designed  to  engage  each  hemisphere  differentially.  Unfortunate- 
ly/many investigators  fail  to  include  such  elementary  controls. 
It  is  sometimes  difficult  to  determine  whether  asymmetries  ob- 
served in  the  control  conditions  are  a function  of  such  variables, 
as  handedness , cerebral  dominance,  ill-balanced  electrode  place- 
ments, or  skuLl  thickness.  Again,  this  problem  is  especially 
severe  in  studies  of  EEG  spectra,  although  large  CNV  asymmetries 
too  have  been  reported  in  a presumably  neutral  task  (Butler  & 
Glass,  1974b),  More  extensive  baseline  data  should  be  collected. 

Validation  of  Task  Variables 


Common  to  a number  of  studies  reviewed  is  the  lack  of  atten- 
tion directed  toward  the  definition  and  validation  of  the  task 
variables  presumed  to  be  the  independent  variables.  Too  many 
investigators  (Brown  et  al.,  1973;  Doyle  et  al . , 1974;  Galin  & 
Ornstein,  1972;  Morgan  et  al.,  1971 ) merely  ask  their  subjects 
to  imagine  relationships  or  to  perform  mental  operations  without 
objectively  verifying  that  the  subjects  are  in  fact  following 
instructions.  Even  when  measurable  responses  are  required  of  the 
subject,  no  systematic  presentation  or  analysis  of  these  be- 
havioral measures  is  made  (see  for  example  Butler  & Glass,  1974a; 
McKee  et  al.,  1973).  Many  studies  leave  the  reader  to  wonder 
whether  the  subject  complied  with  task  demands  and,  if  so,  to 
what  degree.  The  possible  influence  of  task  difficulty  on  these 
results  has  often  been  ignored.  The  subjective  estimates  of 
task  difficulty  that  have  been  used  are  difficult  to  interpret 
without  performance  measures  (Dumas  & Morgan,  1975;  McKee  et  al., 
1973;  Morgan  et  al.,  1974). 

Although  negative  results  are  notoriously  difficult  to  inter- 
pret, confusion  is  compounded  when  EEG  data  are  based  on  intui- 
tively c nosen  tasks  that  have  not  been  validated.  Some  advan- 
tages may  be  gained  by  selecting  standard  neuropsychological 
paradigms  .or  which  differential  hemispheric  engagement  has  been 
assessed  (Neville,  1974) „ It  is  also  important  to  avoid  con- 
founding psychological  variables  with  varying  physical  parameters 
of  the  task-related  stimuli.  Ample  evidence  in  the  literature 
demonstrates  that  the  characteristics  of  ERPs  are  grossly 
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affected  by  physical  stimulus  properties  (see  Regan,  1972) . 
Several  investigators  have  devised  clever  strategies  for  holding 
the  physical  parameters  of  the  stimuli  constant  while  varying 
task  variab3.es  (for  examples,  see  Brown  et  al.  , 1973;  Wood  et  al. 
1971) . 

Range  of  Operation  of  the  Independent  Variables 

The  subject's  tasks  are  usually  chosen  with  the  assumption 
that  the  manipulation  of  the  independent  variable  will  engage  one 
hemisphere  or  the  other.  If  no  interhemispheric  differences  are 
found,  the  investigators  tend  to  deduce  that  electrocortical  ac- 
tivity is  not  related  to  hemispheric  utilization.  This  may  be  a 
rash  deduction.  It  is,  in  fact,  possible  for  the  independent 
variable  to  have  a strong  effect  on  the  laterality  of  the  EEG  for 
values  of  the  independent  variable  other  than  those  selected  for 
study.  Consider,  for  example,  the  assertion  that  the  N1  of  the 
MP  displays  no  lateral  asymmetry.  This  is  in  fact  the  case  when 
the  subject  merely  presses  a switch  or  makes  a light  movement 
with  finger.  If,  however,  the  response  requires  a consider- 
able decree  of  muscular  involvement,  lateral  asymmetries  appear 
(Kutan  3 Donchm,  1974a)  . Similar  results  were  obtained  by 
McCallum  and  papaxostopoulos  (1974)  with  intracerebral  recordings 

W'S  describe,  later,  data  that  suggest  that  increasing  cogni- 
tive demands  likewise  accentuate  the  lateral  asymmetries  in  the 
CNV.  Within  the  same  context,  it  is  important  to  note  that  cog- 
nitive sets  induced  by  the  order  in  which  experimental  conditions 
are  presented  can  influence  the  range  and  direction  of  functional 
asymmetries  (for  behavioral  data,  see  Kimura  & Durnford,  1974; 
Kinsbourne,  1973;  for  application  to  ERP  work,  see  Marsh  & 
Thompson,  1973) . 

Subject  Variables 

It  is  a truism  that  one  should  know  as  much  as  is  relevant 
about  the  present  state  and  past  history  of  the  subject.  Yet, 
such  variables  as  29-*,  sex,  prior  drug  ingestion,  and  amount  of 
sleep,  although  known  to  alter  the  characteristics  of  brain  ac- 
tivity (Perry  & Childers,  1969;  Shagass,  1972;  Regan,  1972),  are 
sometimes  ignored  in  EEG  and  ERP  studies.  Of  critical  import- 
ance in  investigations  of  hemispheric  specialization  is  the  sub- 
ject's histity  of  handedness.  Many  reports  concur  that  sinis- 
crals  differ  from  dextrals  in  their  response  to  and  recovery 
from  cortical  damage  and  in  their  performance  in  a variety  of 
behavioral  tasks  (Hecaen  & Ajuriaguerra,  1964;  Levy,  1974) 

Subject  performance  is  affected  rot  only  by  handedness  but  also 
by  familial  history  of  handedness  (for  references  see  Levy, 

1974).  Apparently,  the  functional  asymmetry  in  the  recognition 
of  tachistoscopic  material  (Bryden,  1965;  Springer,  this  volume) 
and  in  dichotic  listening  (Zurif  & Bryden,  1969;  Berlin,  this 
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volume)  is  appreciably  smaller  for  individuals  with  left-handed 
relatives.  Surprisingly,  a number  of  studies  of  lateralization 
have  failed  to  consider  this  aspect  of  the  subjects'  handedness 
(see  Levy,  this  volume) . 

Assessing  subjects'  handedness  should  be  the  sine  qua  non  of 
all  investigations  of  laterality.  However,  subjective  self- 
classification of  handed.  »ss  is  inadequate  as  it  correlates 
poorly  with  questionnair  s and  motor  performance  (Provins  & 
Cunliffe,  1972;  Satz,  Achenbach,  & Fennell,  1967).  This  is  es- 
pecially true  for  left-handers,  who  tend  to  form  quite  a hetero- 
geneous population  and  often  •d  highly  variable  test  results.  (■  J 
Our  own  experience  (Kutas,  McCarthy,  & Donchin,  1975)  has  been 
that  handedness  is  difficult  to  classify  and  that,  as  a minimum 

requirement,  self-reports  should  be  supplemented  with  question- 
naires. 

Paramurers  of  the  dependent  Variable  ' 

Of  Critical  importance  is  the  selection  of  the  proper  para-- 
meters  of  FDG  or  ERP  activity  for  the  evaluation  of  task- 
induced  changes.  This  is  partly  an  empirical  process  as  many 
Parameters  may  need  evaluation.  These  task-dependent  changes 
may  not  always  reveal  themselves  in  gross  measures  of  overall 
ERP  amplitude  or  Length,  or  in  total  EEG  power  spectra.  They 
often,  in  fact,  ippear  as  small  but  consistent  modulations  of 
specific  ERP  components  or  EEG  bandwidths  (see  Gardiner  & Walter, 
this  volume).  It  cannot  be  overemphasized  that  the  ERP  is  not  a 
unitary  phenomenon,  it  is,  rather,  a sequence  of  independent  com- 
ponents that  react  differentially  to  experimental  variables 
(Donchin,  1969) . 

Care  must  be  exercised  in  creating  composite  dependent  vari- 
ables based  on  various  measures  of  EEG  or  ERP  data.  For  exam- 
ple, interhemispheric  ratios  or  laterality  scores  derived  from 
power  density  spectra  can  provide  a good  summary  statement 
descriptive  of  bilateral  power  relationships,  but  such  ratios 
can  be  misused  and  are  often  misleading.  Ratios  presented  inde- 
pendently of  the  data  on  which  they  are  based  (Doyle  et  al., 

1974;  Galin  S Ornstein,  1972;  McKee  et  al.,  1973)  leave  the' 
reader  uncertain  whether  the  changes  are  caused  by  differential 
engagement  of  the  hemispheres  by  the  tasks  consistent  with  the 
functional  asymmetry  of  the  brain,  or  are  due  merely  to  changes 
in  one  hemisphere,  perhaps  reflecting  task  difficulty.  Reassur- 
ing statements  about  the  specific  locus  of  change  cannot  be  taken 
seriously  unless  supported  by  data  from  each  hemisphere. 

Data  Measurement 


Whatever  the  procedure  for  measuring  the  parameters  of  the  de- 
pendent variable,  no  interpretable  results  can  be  obtained  if 
data  are  improperly  recorded  from  the  scalp.  The  necessity  for  a 
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common  reference  (either  active  or  inactive)  equidistant  from  the 
two  electrodes  being  compared  cannot  be  overemphasized.  The  use 
of  a nonequidistant  common  reference,  such  as  a single  ear  (Gott 
& Boyarsky,  1972),  the  use  of  equidistant  but  separate  refer- 
ences such  as  0X-A  and  02“A2  (Buchsbaum  & Fedio,  1969,  1970; 
Culver  et  al.,  1970;  Fedio  & Buchsbaum,  1971),  and  the  use  of 
intrahemispheric  bipolar  linkages  without  a common  reference, 
such  as  Cj-P^  and  C4-P4  (Butler  & Glass,  1974a;  Matsymiya  et  al., 
1972)  confound  the  assessment  of  hemispheric  asymmetry.  This 
problem  is  especially  acute  as  the  reported  differences  are 
often  a microvolt  or  less. 

A single  nonequidistant  reference  should  be  avoided,  as  acti- 
vity associated  wi'ch  the  reference  electrode  will  be  unequally 
represented  at  the  sites  of  comparison.  Different  unilateral 
reference  electrodes  allow  for  the  possible  introduction  of  sys- 
tematic artifacts  generated  at  a single  reference  but  mistakenly 
identified  as  an  asymmetric  component.  Intrahemispheric  bipolar 
linkages,  on  the  other  hand,  can  mask  existing  interhemispheric 
differences,  because  of  the  common-mode -re jection  characteristic 
of  differential  amplification.  Although  not  without  problems 
(Donehin,  197J),  linked  ears  or  mastoids  ind  chin  or  active  mid- 
line placements  avoid  most  of  the  difficulties  mentioned. 

Tie  number  pi  conditions  and  electrode  placements  necessary 
for  adequate  examination  of  distribut' onal  effects  of  task  vari- 
ables on  ERP  components  produce  too  much  data  to  be  easily 
handled  by  visual  inspection  or  hand-measurement  methods  alone. 
Moreover,  visual  inspection  is  often  inadequate  for  dealing  with 
subtle  differences  between  complex  waveforms.  As  previously  men- 
tioned, marginal  asymmetries,  although  consistent  with  experimen- 
tal manipulations,  can  be  washed  out  by  larger,  symmetric  com- 
ponents (Hillyard,  1973).  Also,  experimental  pffects  may  not 
always  be  evident  as  a measurable  peak  or  trough  in  the  ERP  wave- 
form, but  may  rather  be  manifest  as  a modulation  of  another 
component. 

We  employ  Principal  Components  Analysis  (PCA)  to  identify  the 
distinct  components  of  the  waveform  and  to  assess  their  sensiti- 
vity to  experimental  effects  (Donehin,  1966,  1969;  Donehin, 
Tueting,  Ritter,  Kutas,  & Heffley,  1975)  This  procedure  pro- 
vides an  objective  definition  of  ERP  components  and  measures 
their  contribution  to  each  waveform  with  reference  to  the  entire 
data  set.  A detailed  treatment  of  the  application  of  PCA  to  ERP 
research  is  beyond  the  scope  of  this  paper  (Chapman,  1973; 
Ruchkin,  Villegas,  & John,  1964) . Briefly,  the  ERP  waveform  can 
be  considered  an  estimate  of  the  mean  vector  of  a multivariate 
distribution.  The  PCA  is  one  technique  for  decomposing  this 
mean  vector  into  its  component  vectors.  The  nature  of  this  ex- 
traction procedure  allows  separate  analyses  of  variance  to  be 
performed  on  derived  factor  scores  to  assess  the  sensitivity  of 
the  factors  to  the  experimental  variables.  Thus,  identification 
and  quantification  of  the  experimental  effects  can  proceed  in  an 
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objective  manner.  The  use  of  the  technique  is  illustrated  later 
in  this  chapter. 

Data  Analysis 

It  is  commonly  acknowledged  that  exacting  data-analysis  tech- 
niques are  essential  for  the  proper  evaluation  of  the  effect  of 
experimental  manipulations  on  measures  of  brain  activity.  There 
is  certainly  no  lack  of  analysis  procedures  in  the  literature 
reviewed;  unfortunately,  however,  the  heterogeneity  of  quantifi- 
cation procedures  makes  comparisons  between  laboratories  diffi- 
cult. The  ambiguous  nature  of  many  of  the  paradigms  as  well  as 
the  small  magnitude  of  the  experimental  effects  obtained  in  this 
type  of  research  should  discourage  the  more  liberal  approaches 
to  data  analysis,  which  often  seem  colored  by  the  expectations 
of  the  investigator.  Fundamental  to  the  statistical  evaluation 
of  any  <4ata  is  the  measurement  of  the  magnitude  and  distribution 
of  error  variances.  The  use  of  grand  averaging,  qualitative 
analy<ki3,  and  multiple  univariate  analyses  can  be  criticized  on 
several  grounds,  among  them  a disregard  for  the  range  of  varia- 
bility in  the  data. 

Two  forms  of  data  reduction  often  employed  in  the  analysis  of 
ERPs , grand  averaging  (averaging  waveforms  across  subjects  and/or 
conditions)  and  qualitative  analysis,  give  no  indication  of  the 
real  variability  in  the  data.  Grand  averaging,  although  a useful 
means  for  visually  summarizing  a multitude  of  waveforms,  should 
not  be  used  as  the  ;ole  method  of  analysis  as  no  estimate  of 
error  variance  is  available.  Purel'  qualitative  analyses  (e.g., 
Cohn,  1971)  or  visual  scoring  of  asymmetry  (Butler  & Glass, 

1974b)  are  too  subject  to  experimenter  bias  to  be  the  only  method 
for  assessing  the  influence  of  independent  variables  and,  of 
course,  do  not  allow  for  the  evaluation  of  statistical  signifi- 
cance. 

Many  of  the  statistical  analysis  procedures  used  in  the  de- 
termination of  hemispheric  asymmetries  are  not  merely  inade- 
quate; they  are  often  inappropriate.  The  comparison  of  ERP 
waveforms  and  EEG  power  ratios  through  multiple  univariate  pro- 
cedures (Brown  et  al.,  1973;  Doyle  et  al . , 1974;  Wood  et  al . , 
1971)  without  adjustment  for  the  number  of  tests  being  performed 
can  result  in  misleading  conclusions,  since  the  probability  of 
finding  spuriously  "significant"  difference  is  underestimated 
(see  the  excellent  paper  by  Friedman  et  al.,  1975,  for  a dis- 
cussion of  the  Bonferroni  test).  There  are,  moreover,  multi- 
variate techniques  for  the  analysis  of  ERPs  (such  as  those  re- 
ferred to  previously)  that  take  into  account  the  interdependence 
of  time  points  and  are  not  subject  to  the  aforementioned  criti- 
cisms . 
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SLOW  ERP  COMPONENTS  AND  HEMISPHERIC  INVOLVEMENT 


We  now  describe  studies  from  our  laboratory  that  were  designed 
to  test  the  proposition  that  slow,  preevent,  "anticipatory"  waves 
can  be  used  to  index  hemispheric  utilization.  The  data  provide 
evidence  that  scalp-recorded  EEG  can  be  used  in  studies  of 
hemispheric  specialization. 

These  studies  were  conducted  within  tne  general  framework  of 
our  interest  in  the  endogenous  components  of  ERPs  (Donchin,  1975; 
Donchin  et  al.,  1973,  1975;  Rohrbaugh,  Donchin,  & Ericksen,  1974). 
The  CNV  is  one  of  the  more  prominent  of  these  components 
(McCall urn  & Knott,  1973,  1976) . There  is  no  doubt  that  it  is  a 
manifestation  of  anticipatory  processes,  sensitive  to  a variety 
of  behavioral  manipulations;  yet,  it  turns  out  to  be  strangely 
intractabLe  to  theoretical  analysis.  Various  conflicting  inter- 
pretations have  been  put  forward  (see,  for  example,  McCallum  & 
Knott,  1976).  The  crux  is  the  degree  to  which  the  CNV  represents' 
generalized  attentional  variables  (Karlin,  1970)  or  more  specific 
preparatory  processes  (Taeting  & Sutton,  1973).  It  has  also  been 
difficult  to  tease  out  the  relative  roles  of  motor  and  cognitive 
preparation.  The  evidence  indicates  that  CNVs  can  be  recorded 
in  the  absence  of  specific,  overt,  experimenter-directed  motor 
activity  (Dcr.chm  et  al . , 1972;  Irwin,  Knott,  McAdam,  & Rebert , 
1966)  , yet  it  us  also  clear  that  the  CNV  is  larger  when  a motor 
response  is  required.  £f  motor  preparation  is  an  important  de- 
terminant of  the  slow  potentials,  then  a lateralized  response 
requirement  should  lead  to  a lateralization  of  the  potentials, 
with  larger  amplitudes  recorded  contralaterax  to  the  responding 
hand. 

We  began  by  examining  data  collected  for  other  purposes 
(Donchin  et  al.,  1973)  in  a choice  reaction  time  paradigm.  A 
warning  tone  preceded  one  of  two  possible  flashes  by  1500  msec; 
the  subject  was  required  to  respond  to  one  flash  with  the  right 
hand  and  to  the  other  with  the  left  hand.  In  one  series  of 
trials , the  two  stimuli  altei^jjff ed ; the  subject,  therefore,  knew 
the  hand  with  which  to  respond.  In  another  series,  the  stimuli 
were  presented  in  a random  sequence  and  the  subject  could  not 
predict  the  hand  to  be  used.  Data  were  recorded  from  laterally 
placed  electrodes;  thus  differences  in  the  lateral  symmetry  of 
the  CNVs  obtained  in  the  random  and  the  alternating  sequences 
could  be  determined.  If  motor  preparation  affects  these  poten- 
tials, it  should  operate  during  the  alternating  sequence.  A com- 
parison of  the  cortical  activity  preceding  the  subjects'  re- 
sponses averaged  separately  for  each  responding  hand  failed  to 
reveal  any  lateral  asymmetry  in  either  of  the  experimental  con- 
ditions (Donchin,  Kutas,  & Johnson,  1974) . 

These  data  were  puzzling.  According  to  Kornhuber  and  Deecke 
(1965)  and  Gilden  et  al . (1966),  asymmetric  motor  potentials  pre- 
cede self-paced  motor  responses.  A replication  of  these  studies 
was  attempted  to  determine  whether  a similar  asymmetry  could  be 
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observed  when  the  warning  stimulus  was  eliminated  from  the  se- 
quence. This  attempt  also  failed.  When  subjects  pressed  a but- 
ton at  a self-paced  rate  with  one  hand,  the  potentials  recorded 
from  the  two  hemispheres  were  virtually  identical. 

A possible  explanation  for  this  failure  to  replicate  came  from 
Otto  (personal  communication) , who  reported  finding  a lateral 
asymmetry  in  potentials  preceding  a multiple  finger  response. 

This  was  in  accord  with  reports  that  the  CNV  was  largest  when 
greater  muscular  effort  was  required  (Low  & McSherry,  1968; 
Rebert,  McAdam,  Knott,  & Irwin,  1967).  These  findings  were  ori- 
ginally interpreted  in  terms  of  the  motivational  state  of  the 
subject,  but  it  may  be  that  response-force  per  se  deteimines  the 
CNV  (or  RP)  amplitude. 

A systematic  investigation  of  the  effect  of  force  on  the  RP 
was  therefore  conducted.  The  lateral  distribution  of  the  RP  over 
the  noror  cortex  in  both  right-  and  left-handed  subjects  squeez- 
ing a dynamometer  with  either  hand  at  three  levels  of  force  were 
compared  . The  force  levels  were  calibrated  in  terms  of  the  sub- 
ject's capabilities  rather  than  in  absolute  terms.  In  right- 
handed  subjects,  the  premovement  RPs  (Nl)  were  larger  over  the 
hemisphere  contralateral  to  the  responding  hand.  Left-handed 
subjects  showed  contralateral  dominance  only  when  responding 
with  their  right  hands  (see  Figure  1) . An  analysis  of  the  Nl 
magnitude  revealed  that  although  response-force  does  accentuate 
the  motor  asymmetry,  the  absolute  right-left  asymmetry  does  not 
change  with  increasing  force  levels  (for  a more  detailed  account, 
see  Kutas  & Oonchin,  1974b) . 

It  turns  out,  then,  that  past  failures  to  demonstrate  conclu- 
sively the  hemispheric  asymmetry  of  the  R!  ma/  have  been  due  to 
the  range  of  the  independent  variable  (response-force,  in  this 
case)  and  to  an  inattention  to  subject  variables.  Many  reports 
concerning  the  RP  have  failed  to  mention  subjects'  handedness, 
and  the  few  that  did  mention  it  failed  to  consider  it  in  evalua- 
ting the  data . 

A COMPARISON  OF  READINESS  POTENTIAL  AND  CNVs 

The  results  described  previously  led  to  an  investigation  of 
the  relationship  between  the  lateral  asymmetry  of  the  RP  and 
the  CNV  (Donchin  et  al.,  1974).  Again,  subjects  were  required 
to  squeeze  a dynamometer  with  one  hand  or  the  other.  In  addi- 
tion, various  tests  of  each  subject's  lateral  preference  were 
administered.  After  a detailed  examination  of  various  tests  for 
handedness  (Kutas  et  al.,  1975),  we  selected  the  Edinburgh  ques- 
tionnaire (Oldfield,  1971)  as  an  instrument  of  ohoice. 

In  order  to  make  the  dynamometer  squeeze  less  tiresome  to  the 
subjects,  scenic  slide  presentations  were  madf-  contingent  on 
dynamometer  squeezes  that  attained  a specified  force  level. 

Figure  2 presents  the  sequence  of  events  in  an  experimental  trial 
A self-paced  squeeze,  if  "correct,”  was  followed  after  18 ,1  msec 
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Fig.  1.  A comparison  of  event-related  potentials  (ERPs)  recorded 
at  electrodes  placed  at  left-central  (CJf  solid  line)  and  right- 
central  (C4,  dashed  line)  loci  during  voluntary  squeezes.  Under 
each  pair  of  superimposed  ERPs  we  have  plotted  the  integrated 
electromyogram  (EMG)  (dashed  line)  and  the  output  of  the  force 
transducer  (solid  line)  averaged  over  the  same  trials  over  which 
the  ERP  was  averaged.  Comparisons  are  presented  as  a function  of 
subject's  handedness  (right  versus  left),  nominal  force  output 
(25,  50,  and  75%  of  subject's  maximal  force),  responding  hand 
(right  versus  left)  and  feedback  (presence  or  absence  of  vijual 
signal  indicating  force  level) . Averages  were  obtained  over  all 
subjects , cfter  the  elimination  of  trials  in  which  the  EEG  was 
contaminated  by  electrooculogram  (EGO)  activity.  Number  of 
trials  per  ERP  ranges  between  600  and  1050.  The  polarity  con- 
vention is  negative  up.  Hatching  in  two  areas  of  the  comparisons 
illustrates  the  areas  measured  for  the  purpose  of  the  quantita- 
tive data  analysis.  From  Kutas  and  Donchin,  1074a. 
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Fig.  2.  The  sequence  of  events  in  an  experimental  trial.  Trial 
duration  was  4500  msec.  The  waveform  drawn  above  the  time  line 
is  of  the  ERP  obtained  by  averaging  the  entire  data  set  collected 
from  left-handed  subjects  at  a central  position.  It  serves 
merely  to  indicate  the  time  of  occurrence  of  the  various  ERP 
components . 


by  an  audible  click  (generated  by  the  mechanism  of  the  slide  pro- 
jector) which  was  followed  after  800  msec  by  the  presentation  of 
the  slide.  Thus,  each  trial  consisted  of  three  distinct  phases: 
a preresponse  interval  over  which  an  RP  could  be  recorded,  a 
post  response  interval,  and  finally  the  click-slide  interval 
during  which  a measurable  CNV  could  be  recorded.  This  paradigm 
enabled  a comparison  of  the  hemispheric  asymmetry  of  the  pre- 
movement RP,  which  we  expected  to  vary  as  a function  of  the 
responding  hand,  with  the  hemispheric  symmetry  of  the  CNV.  This 
design  thus  permitted  an  examination  of  the  degree  to  which  the 
asymmetries  observed  by  Kutas  and  Ponchin  (1974a)  were  specific 
to  the  premotor  interval,  or  were  extended  over  a long  interval. 
This  also  allowed  for  an  examination  of  the  possibility  that, 
although  the  i^P  is  asymmetric,  the  CNV  is  symmetric. 

In  Figure  3 are  grand  averages  for  the  right-  and  left-handed 
subjects,  recorded  at  the  frontal,  central,  and  parietal  loca- 
tions. The  ERPs  recorded  at  homologous  hemispheric  sites  are 
superimposed.  These  averages  were  obtained  by  triggering  the 
computer  on  the  dynamometer  squeeze.  Several  aspects  of  the  data 
are  immediately  apparent.  Clearly,  the  squeeze  is  preceded  by  an 
RP,  which  is  asymmetric.  Moreover,  the  asymmetry  reverses  with 
the  responding  hand.  Following  the  squeeze,  a long-lasting  asym- 
metric slow  wave  appears,  which  displays  a polarity  opposite 
that  of  the  presqueeze  potential.  The  CNV  that  follows  the  click 
is  symmetric,  though  superimposed  on  the  slow  wave.  There  are 
substantial  differences  between  the  scalp  distribution  of  the  CNV 
and  the  RP.  The  CNV  is  equally  large  at  the  frontal  and  central 
sites,  but  the  RP  is  largest  centrally.  Note  also  the  sharper 
resolution  of  the  CNV  in  the  parietal  sites. 

A more  detailed  look  at  the  data  is  provided  in  Figure  4, 
where  waveforms  are  shown  for  five  individual  subjects.  The 
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AVERAGE  OVER  RIGHT- MANDEO  SJBJECTS 


Fig.  3.  ERP  waveforms  recorded  from  frontal,  central,  and  pari- 
etal positions . Data  obtained  simultaneously  from  homologous 
sites  tre  superimposed . There  were  approximately  75  trials  per 
subje,  c per  condition. 

curves  displayed  were  obtained  by  element-to-element  subtraction 
of  the  ERPs  at  the  right  and  left  central  electrodes  (these  then 
are  equivalent  to  a "bipolar"  recording  between  the  two  central 
electrodes) . For  each  subject,  data  obtained  with  right-  and 
left-hand  squeezes  were  superimposed.  When  the  premotor  interval 
is  examined,  a strong  measure  of  asymmetry  is  observed.  For  each 
subject  the  potential  difference  reverses  polarity  with  the  re- 
sponding hand.  It  is  important  to  note  that  the  degree  of  polar- 
ity reversal  is  far  more  evident  when  intrasubject  rather  than 
intersubject  comparisons  are  made.  The  specific  difference  wave- 
forms vary  considerably  from  subject  to  subject,  yet  within  sub- 
jects the  potentials  are  of  opposite  polarity,  suggesting  a 
change  in  the  direction  of  laterality. 

No  such  asymmetries  are  observable  for  the  CNV.  Whereas  the 
postresponse  slow  potential  is  quite  prominent  and  seems  to 


DIFFERENCE  CURVES  FOR  ERPS  OBTAINED 
WITH  RIGHT  ANO  LEFT  HAND  RESPONDING 


Fig.  4.  All  waveforms  shown  in  this  figure  were  obtained  by 
poirt-to-point  subtraction  of  ERPs  recorded  at  the  left-central 
electrode  from  ERPs  recorded  at  the  right-central  electrode . 

This  difference  will  be  negative  if  the  left-hemisphere  potential 
is  larger,  and  positive  if  the  right-hemisphere  potentials  are 
larger.  For  five  subjects  (three  dextral  and  two  sinistral)  we 
superimposed  data  obtained  when  subjects  were  squeezing  a dynamo- 
meter with  the  right  hand  (solid  line)  and  the  left  hand  (dashed 
line).  Each  waveform  represents  an  average  of  75-80  trials. 

The  first  vertical  line  separates  pre-  from  postsqueeze  activity; 
the  second  and  third  lines  delineate  the  click-slide  interval 
(CNV)  . 

extend  over  the  entire  recorded  epoch  and  probably  be}©rtd  it,  the 
click-flash  CNV  is  apparently  equal  in  amplitude  at  both  sites. 

A quantitative  statement  of  this  trend  is  shown  in  Figure  5.  We 
have  fitted  a quadratic  function  to  the  RP  and  to  the  CNV  seg- 
ments of  the  curve.  In  Figure  5 is  a plot  of  the  coefficients 
of  the  quadratic  terms  that  were  computed  for  ERPs  associated 
with  right-hand  squeezes  against  coefficients  associated  with  the 
left-hand  squeezes.  If  the  two  curves  show  opposite  polarity, 
the  coefficients  should  be  of  opposite  sign.  For  the  RP,  the  co- 
efficients are  large,  and  for  most  subjects  the  magnitudes  of 
the  two  coefficients  are  reasonably  similar,  but  the  signs  are 
different.  For  the  CNV,  the  coefficients  are  clustered  around 
the  origin  and  show  no  tendency  toward  opposite  polarity. 

These  data  provide  support  for  the  idea  that  lateral  asymmetry 
can  be  used  as  an  index  of  hemispheric  utilization.  Shifts  in 
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tig.  5.  Regression  coefficients  of  the  quadratic  term  obtained 
from  a polymmial  fit  to  the  premovement  ( full  circles)  and  CNV 
(crossed  circles)  region  of  the  difference  waveforms  illustrated 
in  Figure  4.  Coefficients  computed  on  the  basis  of  right-hand 
response  data  are  plotted  against  coefficients  obtained  when 
subjects  were  Squeezing  with  their  left  hands. 

asymmetry  appear  to  be  quite  rapid  and  are  finely  tuned  to  shifts 
in  the  subject's  tasks.  The  nature  and  significance  of  the  long, 
slow,  postresponse  wave  is  not  clear,  yet  it  is  obvious  that  the 
more  rapid  shifts  in  asymmetry  can  be  detected  when  they  are 
superimposed  on  such  long-term  trends.  Thus,  these  data  lend 
plausibility  ;o  the  "two-factor  hypothesis,"  which  views  antici- 
patory negative  shifts  as  a mixture  of  motor  and  cognitive  pre- 
paratory processes  (Hillyard,  1973) . 

LATFRAL  ASYMMETRIES  IN  A CNV  PARADIGM 

Although  the  data  presented  in  the  preceding  section  demon- 
strate the  differential  anterior-posterior  and  interhemispheric 
distribution  of  the  RP  and  CNV,  it  remains  to  be  determined  if 
the  CNV  is  always  symmetric  or  perhaps,  with  proper  choice  of 
tasks,  can  be  lateralized.  Conceivably,  just  as  a forceful 
squeeze  was  required  to  demonstrate  the  asymmetry  of  the  RP,  a 
stronger  cognitive  "squeeze"  might  be  required  to  demonstrate  the 
lateralization  of  the  CNV.  fin  experiment  was  designed,  therefore 
to  manipulate  task  variables  that  might  contribute  to  the  forma- 
tion of  an  asymmetric  CNV. 

The  task  chosen  was  patterned  after  the  Structure-Function 
matching  task  developed  by  Levy  (1974)  in  her  work  with  commis- 
surotomized  patients.  One  of  two  warning  tones  (1000  Hz  or  2000 
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Hz)  preceded,  by  1000  msec,  a brief  150  msec)  presentation  of  a 
slide.  Each  slide  contained  three  figures,  lwo  of  whiph  formed 
a structural  or  "look-alike"  match  (right-hemisphere<?dominant 
task)  and  two  of  which  formed  a functional  or  conceptual  match 
(le^t-hemisphereGWbminant  task) . Both  types  of  matches  could  be 
made  from  each  slide  with  one  figure  common  to  the  two  matches 
(see  Figure  6)  . Subjects  responded  by  pressing  one  of 


Fig.  b.  One  of  the  42  slides  i ed  in  the  study.  The  ax  and  the 
tree  ate  functionally  matched;  uhe  ax  and  the  flag  are  struc- 
turally matched.  If  cued  to  make  a functional  match,  the  sub- 
ject would  respond  by  pressing  a button  with  the  second  finger 
of  his  rig.it  hand.  For  a structural  match,  the  subject  would 
press  a button  with  tie  third  finger. 
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buttons  (with  one  of  three  fingers  of  the  right  hand)  coded  for 
the  three  possible  figure  combinations.  Subjects  were  instructed 
to  respond  as  quickly  as  possible  following  the  slide  presenta- 
tion. Reaction  time  (RT)  and  the  subject's  choice  were  recorded 
for  each  trial  along  with  2000  msec  of  EEG  from  a nine-electrode 
montage  (F3,  F4,  C3,  C4,  P3,  P4 , F2 , Cz,  Pz  —according  to  the 
10-20  system  for  electrode  placement) . The  vertical  electroocu- 
logram (EOG)  was  recorded  on  a separate  channel.  Trials  associ- 
ated with  eye  movements  were  excluded  from  analyses.  Recording 
of  the  EEG  data  began  200  msec  prior  to  the  warning  stimulus. 

(For  data-acquisition  procedures  see  Donchin  & Heffley,  1975.) 

Two  general  experimental  conditions  were  used.  In  fixed-match 
series  the  warning  tone  was  the  same  on  all  trials  in  a run,  the 
subject  making  the  same  match  on  each  trial.  In  mixed-match 
series,  the  tones  varied  randomly  from  trial  to  trial,  and  the 
required  match  varied  accordingly.  For  each  subject  each  tone 
pitch  was  always  associated  with  one  match  type.  An  additional 
series  was  used  in  which  the  subject  was  instructed  to  respond  by 
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using  a single  response  button  to  all  slides.  Results  were  ob- 
tained in  a pilot  study  of  five  female  subjects,  ?H  dextral  (as 
verified  by  the  Edinburgh  Inventory,  Oldfield,  1971)  and  all 
without  sinistral  relatives. 


The  reaction  times  and  matching  errors  are  presented  in  Figure 
apparent  that  Doth  measures  differ  significantly  as  a 
function  of  task.  These  data  establish  that  the  two  tasks 
placed  different  demands  on  the  subjects.  This  does  not,  of 
course,  prove  that  the  two  tasks  engaged  the  hemispheres  differ- 
enti* 1 
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PERFORMANCE  DATA  FOR  EACH  EXPERIMENTAL  CONDITION 
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in  reaction  tine  (p  < .0005,  F = 21.66 , d t = i,10J  a.m  ^x- 
centage  correc *:  (p  < .048,  F = 4.57,  df  = 1,16)  between  struc- 
tural and  function# l matching  are  significant . Abbreviations : 

SD,  structural/ fixed-match  condition;  SM,  structural /mixed-match; 
FF,  functional/ fixed-match;  FM,  functional/mixed-match;  RT,  base- 
line reaction  time  to  signal  with  no  match  reguired . 


Hemispheric  engagement  was  assayed  by  spectral  analysis  of  the 
single-trial  EEG  data.  It  was  necessary  to  determine  if  changes 
in  the  distribution  of  power  within  the  delta  (1-3.5  Hz',  theta 
Hz)  , and  alpha  Hz)  bandwidtho  accompanied  per- 

formance of  the  tasks.  The  data  analyzed  were  the  2000— msec 
epoch,  which  included  1200  msec  of  preslide  EEG  as  well  as  800 
msec  of  data  taken  while  the  subject  was  actively  performing  the 
task.  Figure  8 (top  frame)  presents  the  distribution  of  power 
within  each  frequency  band.  An  analysis  ot  variance  of  power- 
measures  at  each  band  was  performed  to  determine  if  the  nature  of 
the  matching  task  affected  the  scalp  distribution  of  the  power. 
Our  data  indicated  that,  within  the  alpha  bandwidth  only,  the 
tasks  differentially  affected  the  distribution  of  power,  primari- 
ly at  the  parietal  electrode  sites  (p  < .03;  F = 2.97,  df  = 5,20). 
There  is  relatively  less  alpha  activity  (see  Figure  8,  bottom 
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Fig.  8.  Top:  distribution  of  the  mean  power  for  tt.e  delta 

(i~3.5  Hz)  , t.ieta  (4—7.5  Hz)  , and  alpha  (8—12  Hz)  bands  is  shown 
for  left  and  right  frontal  (FJr  F4) , central  (C3,  C4)  , and 
parietal  (Pj,  P4)  electrode  sites.  The  data  for  analysis  were 
obtained  from  the  fixed-structural  or  functional-match  condi- 
tions. Data  from  15  trials  in  which  the  subject  responded  cor- 
rectly were  used  for  each  analysis.  Bottom:  the  task  by  elec- 

trode interaction  for  power  and  the  alpha  band.  The  power  a^so- 
ciated  with  functional  matching  is  lower  at  all  electrode  posi- 
tions than  the  power  associated  with  structural  matches.  The 
difference,  however,  is  accentuated  at  the  left  parietal  position. 

frame)  at  the  left  parietal  (P^)  during  functional  matching  than 
during  the  structural  matching.  Our  data  are  too  preliminary  to 
permit  a strong  statement  concerning  the  relationship  of  these 
differences  to  hemispheric  specialization;  it  is  conceivable  that 
the  changes  at  are  related  to  task  difficulty— recall  that 
functional  matching  was  performed  more  slowly  and  less  accurately 
than  structural  matching.  Figure  8 (bottom)  shows  that  the  func- 
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tional  match  power  is  smaller  than  structural  match  power  at  all 
electrode  sites.  Nonetheless,  the  differences  are  interesting 
and  provide  suggestive  evidence  of  the  efficacy  of  our  tasks  in 
differentially  engaging  the  hemispheres. 

Of  central  concern  in  the  design  of  this  experiment  was  the 
extent  to  which  preparation  to  perform  different  analyses,  pre- 
sumed to  engage  the  hemispheres  differentially,  would  result  in 
the  formation  of  asymmetric  CNVs  prior  to  slide  presentation. 

Grand  averaged  waveforms  (Figure  9)  for  all  experimental  con- 
ditions reveal  large  asymmetries  in  the  CNVs  for  all  match  condi- 
tions relative  to  the  RT  conditions.  The  most  consistent  asym- 
metries appear  in  the  mixed  conditions.  Note  that,  when  asymme- 
tric , the  left-hemisphere  potential  amplitudes  always  exceed  the 
right-hemisphere  potentials.  In  the  mixed  series,  a prominent 
positive  component  appears  450  msec  after  the  warning  stimulus. 
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Fig.  9.  Grand-averaged  waveforms  for  frontal,  central,  and  pari- 
etal electrode  positions  for  all  experimental  conditions  for  all 
trials  in  which  the  subject  responded  correctly.  Right  (solid 
line)  and  left  (dashed  line)  lateral  petitions  are  superimposed. 
The  vertical  lines  indicate  the  occurrences  of  the  warning  tone 
(SI)  and  slide  (s 2) . 
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To  illustrate  the  variability  in  the  data,  averaged  waveforms 
from  individual  subjects  for  the  mixed  series  are  presented  in 
Figure  10.  For  a more  objective  analysis,  the  waveforms  from 
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Fig.  lu.  cnr  i com  rive  subjects  tor  uerr  (uaoneu 
(solid  line)  frontal  electrode  positions  (superimposed) 
shown  for  the  mixed-match  condition. 


~nd  right 
are 


each  subject,  electrode,  and  condition  were  submitted  as  a data 
matrix  to  a Principal  Components  Analysis  followed  by  Varimax 
rotation.  Six  orthogonal  factors  were  extracted  from  the  data, 
accounting  for  78%  of  the  experimental  variance.  A plot  of  the 
factor  loadings,  representing  the  degree  of  association  of  each 
time  point  with  each  factor,  is  presented  in  Figure  11.  Such  a 
plot  identifies  the  temporal  locus  of  activity  f c r each  ef  the 
factors.  Factor  scores,  derived  from  these  facto).-  loadings, 
measure  the  degree  to  which  each  factor  contributes  f the  wave- 
forms for  each  condition  and  electrode  placement,  aims,  it  is 
possible  to  assess  the  degree  to  which  esc'-’  factor  xs  affect-- u 
by  the  experimental  conditions  and  to  evaluate  the  relationships 
statistically.  Space  does  not  permit  a fui.1  discussion  of  the 
behavior  of  each  factor,-  attention  will  there  tor®  oe  l-ectrictec* 
to  the  two  factors  (1  and  2)  clearly  within  the  UP  r ^ion. 

The  time  course  of  factor  1 is  similar  to  that  -f  a CNV,  peak  ■ 
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Fig.  u.  Factor  loadings  for  six  orthogonal  factors  extracted 
by  Principal  Comment  Analysis  and  rotated  by  the  Varimax  pro- 
cedure. The  loadings  represent  the  temporal  locus  of  activity 
for  each  of  the  six  factors. 

ing  :uat  after  the  slide  (S2)  . The  factor  scores  indicate  that 
this  factor  is  maximal  at  the  central  electrodes  declining  in 
amplitude  in  the  frontal  and  parietal  electrodes  (p  < .001,  F = 
20.44,  df  = 7,23).  The  decline  is  steeper  toward  the  parietal 
thar  frontal  sites.  This  scalp  distribution  has  often  been  re- 
ported for  the  CNV.  These  scores  also  indicate  that  this  com- 
ponent, which  we  identify  with  the  CNV,  is  laterally  asymmetric; 
it  is  more  negative  at  the  left  hemisphere  for  all  homologous 
pairs.  This  asymmetry  appears  to  be  affected  by  mode,  appearing 
to_be  more  marked  for  the  mixed  than  the  fixed  series  (p  < .025, 
F - 2. 11,  df  = 7,28).  The  three-way  interaction,  electrode 
position  X matching  task  X mode  (p  < .007,  F 3.51,  df  = 7,28) 
indicates  that  this  factor  is  largest  for  the  two  mixed  condi- 
tions and  indicates  that  the  asymmetry  is  least  pronounced  in 
the  functional  fixed  condition. 

Factor  2 peaks  approximately  475  msec  after  the  warning  tone 
(SI),  its  latency  suggests  that  this  factor  nu,y  be  the  same  as 
the  early  component  of  the  CNV  described  by  Loveless  and  Sanford 
(1974,  1975)  and  heretofore  only  seen  with  very  long  interstimu- 
lus intervals.  Mode  has  a very  pronounced  effect  upon  the 
/M^terior-posterior  distribution  of  this  factor  (p  < .001,  F = 
8.05,  df  =7,28).  When  SI  conveys  no  information  about  the  task 
to  the  subject  (as  in  the  fixed  series),  this  factor  is  negative 
at  all  electrode  /ites,  appearing  largest  frontally.  When  SI  is 
task  relevant  (as  in  the  mixed  series)  , this  component  becomes 
positive  in  the  parietal  regions  and  marginally  more  negative 
frontally.  The  effect  of  matching  tasks  on  this  component  is  not 
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statistically  significant  (p  < .066,  F = 2.18,  df  = 7,28)  but 
nonetheless  intriguing.  At  the  frontal  sites,  this  component 
appears  to  change  its  lateral  distribution  as  a function  of  task; 
appearing  larger  over  the  left  hemisphere  for  functional  tasks 
ard  larger  over  the  right  hemisphere  for  structural  matching. 

The  data  just  described  demonstrate  that  CNVs  of  different 
amplitudes  can  be  simultaneously  recorded  from  homologous  elec- 
trodes. The  CNV  is  asymmetric  when  the  matching  mode  varies 
randomly  from  trial  to  trial.  The  evidence  also  indicates  that 
when  the  mode  of  matching  is  uniform  over  a block  of  trials  (as 
in  the  fixed  condition)  the  CNV  is  more  rymmetric.  It  seems 
then  that  the  extent  to  which  the  asymmetry  is  observable  may 
depend  on  the  strategies  the  experimental  situation  permits  the 
subject  to  adopt. 

It  is  noteworthy  that  the  direction  of  asymmetry  is  indepen- 
dent of  the  match  required  (structural  versus  functional) . 
Clearly,  the  CNV  does  not  reverse  asymmetry  in  preparation  for 
tasks  that  presumably  engage  one  or  the  other  hemispheres.  A 
detailed  replication  of  the  experiment  is  now  underway,  using  a 
larger  sample  and  a richer  set  of  control  conditions.  Although 
the  new  data  seem  to  corroborate  the  data  presented  here,  the 
nature  cf  the  observed  asymmetry  must  be  more  fully  elucidated 
in  relation  to  the  response  requirements  of  the  task. 

Not  directly  related  to  the  asymmetry  question,  yet  a theo- 
retically important  aspect  of  these  data,  is  the  support  they 
lend  to  the  reports  (W  :erts  & Lang,  1973;  Loveless  & Sanford, 
1974,  1975) , that  two  distinct  components  may  operate  in  the  CNV 
interval.  These  components  vary  in  scalp  distribution  and  in 
their  sensitivity  to  task  demands. 


SUMMARY 

We  have  reviewed  the  evidence  for  the  proposition  that  differ- 
ences between  the  electrical  activity  recorded  at  homologous 
scalp  locations  over  the  left  and  right  hemispheres  can  be  used 
to  index  hemispheric  utilization.  There  seems  to  be  adequate 
support  for  the  assertion  that  the  ratio  of  EEG  power  over  the 
hemispheres  if,  sensitive  to  task  variables.  The  direction  of  the 
difference  is  to  some  extent  ;onsistent  with  predictions  derived 
from  contemporary  ideas  about  hemispheric  specializations.  Of 
the  various  ERP  parameters  studied,  the  s^yfdiest  results  come  (_i ,? 
from  investigations  of  anticipatory  potentials  that  appear  to  be 
asymmetric,  again,  in  the  predicted  direction. 

These  trends  are  far  from  conclusive.  Some  methodological 
problems  were  reviewed.  Attention  should  be  paid  to  the  inde- 
pendent validation  of  the  behavioral  effects  of  experimental  in- 
structions, to  the  greater  sensitivity  of  within-group  repeated- 
measures  designs,  to  the  choice  of  EEG  parameters  for  study,  and 
to  the  measurement  and  analysis  of  data. 
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We  have  presented  data  that  demonstrate  that  (1)  slow  poten- 
tials preceding  a voluntary  self-paced  motor  response  are  largest 
over  the  hemisphere  contralateral  to  the  responding  hand  (at 
least  in  dextrals) ; (2)  the  preresponse  asymmetry  can  coexist 
with  cognitive  anticipations  which  are  symmetric;  (3)  the  pre- 
response asymmetric  readiness  potentials  appear  to  be  followed 
by  a prolonged  potential  shift  with  a uoi^rity  apparently  inverse 
to  that  of  the  motor  potential;  (4)  when  the  information-process- 
ing load  is  increased,  some  lateralization  effects  seem  co  occur 
in  the  CNV;  and  (5)  both  this  CNV  negativity  and  task-related 
shifts  power  in  the  alpha  band  appear  mostly  as  modulation  of 
left-hemisphere  activity  rather  than  as  reciprocal  changes  in 
hemispheric  activities. 
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The  concept  of  “components”  has  played  a 
central  role  in  the  study  of  average  event-re- 
lated potentials  (ERPs).  Most  investigators  re- 
port, and  discuss,  the  experimental  variables 
in  terms  of  their  effects  on  one,  or  on  several, 
components.  The  ERP  is  thus  viewed  as  a se- 
quence of  serially  activated  processes  mani- 
fested on  the  scalp  as  distinct  positive— nega- 
tive potential  fluctuations.  It  has  been  cus- 
tomary to  identify  the  components  by  the 
presence  or  absence  of  prominent  peaks  at 
particular  latencies.  Numerous  investigators 
have  reported  striking  effects  on  a component 
0|_  labeled  P300  (or  P3)  ^/independent  variables 
a-  which  manipulate  the  psychological  context 
in  which  the  eliciting  stimulus  has  been  pre- 
sented (cf.  Price  and  Smith  1974).  With  few 
exceptions  (Donchin  et  al.  1973,  1975)  these 
results  have  been  reported  in  terms  of  the 
base-to-peak  amplitude  of  a peak  in  the  wave- 
form with  a latency  of  250—450  msec. 

N.  Squires  et  al.  (1975)  presented  data  sug- 
gesting that  several  additional  components 
can  be  observed  within  an  interval  ranging 
from  100  to  600  msec  after  the  eliciting 
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event  which  are  affected  by  those  variables 
known  to  affect.  P300.  Their  interest  was  cen- 
tered mostly  on  a positive  peak  with  a latency 
of  about  270  msec  which  they  labeled  P3a, 
whose  appearance,  unlike  P300,  did  not  de- 
pend on  stimulus  relevance.  They  also  men- 
tion a N200,  which  was  probably  related  to 
similar  components  at  about  this  latency 
which  have  been  reported  by  Ford  et  al. 
(1973),  Picton  et  al.  (1974),  Simson  et  al. 
(1976)  and  Ruchkin  and  Sutton  (in  press). 
Finally  they  report  that  a “slow  wave”  fol- 
lows P300  which  was,  like  P300,  sensitive 
to  stimulus  relevance,  but  which  jould  not 
be  easily  dissociated  from  the  P300. 

The  problem,  of  course,  is  that  when  two 
components  summatc  they  may  not  be  sepa- 
rable on  the  basis  of  variations  in  peak  ampli- 
tude alone.  It  is  also  rather  difficult  to  deter- 
mine whether  an  experimental  variable  affects 
a given  component  directly  or  ind’rectly 
(through  an  effect  oil  another,  overlapping, 
component).  It  is  apparent,  then,  that  as  the 
process,,  underlying  the  generation  of  the  ERP 
are  resolved  with  ever-finer  detail,  exclusive 
reliance  on  the  visual  identification  of  com- 
ponents alone  becomes  increasingly  inade- 
quate (Donchin  1966,  1969). 

As  N.  Squires  et  al.  (1975)  state,  tney  have 
found  it  difficult  to  dissociate  the  “slow 
wave”  from  P300.  Neither  have  they  clarified 
the  relationship  between  N200  (N2  in  their 
terminology)  and  the  P3a  component.  Yet, 
the  dissociation  of  these  components  is  of 
considerable  significance  in  view  of  Naatanen’s 
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detail  the  ERP  components  which  occur  in 


(1975)  “three  component  hypothesis  of  the 
EP”.  In  a very  detailed  and  critical  analysis 
of  the  P300  literature  Naatanen  questions  the 
distinctness  of  P300  as  an  endogenous  compo- 
nent of  the  evoked  potential.  In  his  view, 
"•  • • many  components  claimed  to  be  P3  or 
P300  and  many  reported  enhancements  of 
this  component  might  in  fact  signify  ‘only’ 
a non-specific  change  of  state  of  the  organism 
(occurring  most  often  after  the  relevant  stim- 
ulus) or  to  be  of  artifactual  origin’’  (Naatanen 
1975,  p.280). 

To  account  for  the  data  which  appear  to 
contradict  his  view  Naatanen  postulates  “a 
temporally  overlapping  longer-duration  posi- 
tive process  which  might  start  already  at  50- 
100  msec  post  stimulus,  peak  at  200-500 
msec  post  stimulus  and  last  up  to  1 second 
. . . This  component  overlaps  two  negative 
peaks  Nl  and  N2  — which  together  with 
this  slow  positive  component  determine  the 
waveform  of  the  ERP”. 

Naatanen’s  view  is  persuasively  argued,  but 
it  lacks  direct  evidence.  The  slow  positivity 
he  posits  might  be  closely  related  to  the  “slow 
wave”  described  by  N.  Squires  et  al.  (1975). 
It  thus  becomes  important  to  determine  the 
relationship  of  the  P300  and  the  slow  wave. 
Are  these  two  distinct  components,  or  are 
they  as  Naatanen  seems  to  propose,  two  as- 
pects of  the  same  component.  Similar  reason- 
ing applies  to  the  problem  of  the  relationship 
of  P3a  and  the  N200,  which  according  to 
Naatanen  would  also  interact. 

It  is  of  course  difficult  to  dissociate  such 
overlapping  components.  The  problem,  how- 
ever, is  somewhat  analogous  to  the  problem 
of  the  relationship  between  the  contingent 
negative  variation  (CNV)  and  P^00.  This 
problem  has  been  successfully  Uc'.ded  by 
Donchin  et  al.  (1975)  using  the  Principal 
Component  technique  for  dissecting  apart 
evoked  response  components.  We  decided 
therefore  to  apply  the  same  technique  to  data 
collected  in  the  manner  described  by  N. 
Squirts  el  at.  (1975).  Ttivis  in  this  paper  we 
report  a replication  of  the  Squires  et  al.  study, 
the  intent  of  which  was  to  examine  in  more 


the  time  range  of  150—  600  msec  after  the 
stimulus 


Methods 
Experiment  I 

Subjects.  Nine  normal  young  adults,  includ- 
ing three  experimenters,  served  as  subjects. 
Two  of  the  non-experimenter  subjects  had 
served  in  previous  evoked  potential  experi- 
ments but  they,  along  with  the  four  naive 
subjects,  were  not  familiar  with  the  purpose 
of  the  experiment. 

Stimuli.  Tone  bursts  were  delivered  binau- 
rally  through  TDH-39  earphones  at  the  rate  of 
one  every  1.3  sec.  Tone  frequency  was  100 
c/sec  and  each  tone  was  of  a total  duration 
of  60  msec  (10  msec  rise— fall  time)  gated  in 
a random  phase.  Two  signal  levels  were  used, 
the  ‘loud’’  stimulus  was  80  dB  SPL  and  the 
soft  stimulus  was  60  dB  SPL.  Stimuli  were 
presented  against  a continuous  background  of 
wide-band  noise  at  50  dB  SPL. 

Recording  system.  The  EEC  was  recorded 
from  9 electrode  sites  (P3,  C3,  F3,  P*.  Cz,  Fz, 
P«,  C«  and  F4  according  to  the  10—20  system) 
referred  to  linked  mastoids.  The  ground  elec- 
trode was  on  the  right  wTist.  For  scalp  record- 
ing Burden  Ag— AgCl  electrodes  were  affixed 
with  collodion.  Beckman  biopotential  elec- 
trodes were  affixed  on  the  mastoids  with  ad- 
hesive collars.  In  addition,  Beckman  elec- 
trodes were  placed  above  and  below  the  right 
eye  to  record  the  EOG  and  blink  potentials 
in  parallel  with  the  scalp  recordings. 

Electrical  potentials  were  amplified  with 
Grass  7P122  amplifiers  (time  constant  0.8  sec 
and  upper  half  amplitude  frequency  60  c/sec). 

Wc  hridtliut  ttier^  arc  all  too  few  replications  of  ex- 
peri  meats  in  evoked  potential  research.  In  our  view 
progress  in  011/ understanding  of  the  ERP  depends 
cm  Hhi  mrvvm  ibtiofi  «f  a 

ed,  re  plica  Ltd,  data,  and  if  j?  replication  allows  a 
more  det^fled  look  at  the  components,  so  much  the 
better.  • 
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TASK  RELEVANCE,  STIMULUS  PROBABIL'  I’Y  AND 

The  EEC  was  sampled  for  768  msec  beginning 
1U0  msec  prior  to  stimulus  onset  at  a rate  of 
333  samples/sec  (1  sample  every  3 msec). 

Dwte  wtteeiion,  The  experiment  w»a  eon 
trolled  by  a PDP11/40  computer  which  vas 
also  responsible  for  data  acquisition  (Donchin 
and  Kef  ley  1975).  Digitized  single-trial  data, 
as  web  as  ERPs  averaged  on-line  for  each 
block  of  trials,  were  stored  on  digital  magnet- 
ic tape  for  later  anal}  sis.  Eye  movement  and 
blink  artifacts  were  removed  off-line,  either 
by  eliminating  the  block-average  ERP  in 
which  substantial  EOG  activity  appeared,  or 
by  recomputing  the  ERP  using  the  single-trial 
data  and  eliminating  trial*  with  F'.UG  artiforcs. 
Data  analyses,  using  thq^SOUPAC  statistical 
package  (Dickman  1J372L  were  performed 
either  at  the  Comput’oroervices  Office  of  the 
University  of  Illinois  or  the  Campus  Comput- 
ing Network  at  UCLA,  using  the  ARPANET 
for  communication.  Most  analysts  were  dupli. 
cated  with  the  BMD-P  package  fDixon  1975). 

Procedure.  The  subject  sat  in  a reclining 
chair  in  an  unshielded  experimental  room. 
Prior  to  each  block  of  200  trials  the  subject 
was  instructed,  via  an  intercom,  either  to  lis- 
ten to  the  train  of  tones  nnd  count  ihe  num- 
ber of  loud  tones,  to  be  reported  at  the  end  of 
the  block,  or  to  ignore  the  tones  and  concen- 
trate on  another  task.  In  the  latter  condition, 
the  subjects  searched  for  words  in  a matrix 
of  letters,  except  for  the  three  experimenter's, 
who  read  a book.  In  the  word-game  task  a 
bonus  was  paid  according  to  the  number  of 
words  correctly  identified.  Data  obtained  in 
this  condition  are  labeled  “ignore”  in  all  fig- 
ures and  tables. 

Within  each  block  of  trials  the  probability 
that  the  loud  stimulus  would  occur  on  any 
trial  was  either  0.10  or  0.90  (the  soft  stimulus 
was  presented  at  the  complementary  probabi- 
lity) Priof  to  each  btork  ll#  subject  wot  in- 
formed of  the  probability  of  each  stimulus. 

The  experimental  design  was  a repeated- 
mcasurcmcnt,  1-way  factorial  design.  The 
four  main  factors  were  stimulus  intensity 
(loud  vs.  soft),  stimulus  probability  (rare  vs. 
fnxpunl),  link  (rcu- 1 ignore),  and  due 
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trode  location  (with  subject  variance  aopear- 
mg  in  the  error  term,  cf.  Keppel  19711  Each  L~/ 
combination  of  stimulsp/  probabiflTy'apd  task^DfA:- 
«ai  related  3 ir/rrts  within  a' 
single  2 h experimental  session  (a  total  of  *<  ' 
600  trials  per  condition).  Thus  on  60  trials 
the  rare  stimulus  was  presented  and  on  540 
trials  the  frequent  stimulus  was  presented 
Note  that  while  the  design  calls  for  8 “cells” 
(excluding  the  electrode  factor),  only  4 series 
were  used,  each  series  yielding  data  for  two 
of  the  cells,  one  set  of  waveforms  for  loud 
stimulus  and  one  for  soft.  For  each  subject, 
the  second  series  balanced  the  first  series  and 
thi-  third  villwi  the  same  ac  the  fiiit  of 
quasi-randomized  to  control  for  order  effects. 

The  initial  series  differed  over  subjects. 

Exoeriment  II 

The  experiment  was  repeated  with  nine 
subjects,  three  of  whom  participated  in  Ex- 
periment I.  Of  the  six  new  subjects,  two  had 
participated  in  previous  evoked  potential  ex- 
periments. All  experimental  procedures  were 
identical  to  those  used  in  Experiment  I,  ex- 
cept that  exycrfTijenlal  series  weft  mldtd  ir. 
which  the  subject  was  instructed  to  count  the 
rare— soft  stimuli.  There  were  thus  6,  rather 
than  4,  trial  series  for  each  subject.  Each  con- 
dition was  presented  twice  for  a total  of  400 
stimulus  presentations.  In  the  “ignore”  con- 
dition all  subjects  performed  the  word -game 
task. 


Results 

A review  of  ERP  waveforms 

The  ERP  waveforms  obtained  from  the  . 
three  mkMim.  tleetfv.de  (Pz,  Cz  and  Fz>  in 
all  four  experimental  conditions  in  Experi- 
ment I are  shown  for  one  subject  in  Fig.  1. 

The  ERf’s  elicited  by  frequent  stimuli  (P 
- 0.9)  in  all  experimental  conditions  were 
characterized  by  the  N100  and  P160  peaks  of 
It#  wfdib.ry  evoked  pTur.tiJ  (Davis  196L). 
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Fig.  1.  ERP  waveforms  for  one  subject  for  the  eight 
conditions  in  Experiment  I,  at  the  three  mid-iine  elec- 
trode sites  (Pz,  Cz.  PZV  The  loud  stimulus  ERP  wave- 
forms are  on  the  left  and  those  for  the  soft  stimulus 
are  on  the  right.  In  the  upper  half  of  the  figure  are 
the  waviforms  from  the  conditions  where  the  proba- 
bility of  the  loud  stimulus  was  0.1,  an’  the  count 
loud  condition  is  shown  above  the  ignore  condition. 
The  corresponding  waveforms  when  the  probability 
of  the  loud  stimulus  was  0.9  are  shown  in  the  bottom 
half  of  the  figure.  The  total  waveform  epoch  is  768 
msec  and  stimulus  occurrence  is  indicated  by  the 
black  bar  on  the  time  scale.  Negativity  at  the  active 
electrode  is  shown  upwards  in  all  figures. 


No  additional  peaks  were  prominent  in  those 
waveforms. 

Rare  stimuli  ( P = 0.1)  elicited  ERPs  with 
complex  waveforms,  the  exact  shape  of  which 
depended  upon  the  task  relevance  of  the 
tones.  For  task-relevant,  rare  stimuli  a large 
positive  peak  with  a mean  latency  of  358 
msec  (P350)  appealed  in  the  waveform.  Also 
clear  in  those  waveforms  were  a “slow  wave” 
(SVV),  predominant  over  the  last  200  msec  of 
the  epoch,  and  a negative  peak  preceding 


P350  with  a mean  latency  of  213  msec 
(N210).  On  the  leading  slope  ol  P350  another 
positive  peak  was  discernible,  often  only  as  an 
inflection,  at  a mean  latency  of  282  msec. 

When  the  tones  were  rare  but  irrelevant  a 
quite  different  picture  emerged.  The  P350 
peak  was  much  reduced  in  amplitude  relative 
to  when  the  stimuli  were  task-relevant  and  the 
SW  was  absent.  The  N210  peak  (mean  latency 
215  msec)  remained  prominent  and  wac  often 
followed  by  a positive  peak  (P270). 

The  data  from  four  subjects  in  Experiment 
I who  exhibited  the  major  variants  of  the  ERP 
waveform  are  shown  in  Fig.  2 to  illustrate  the 
range  of  intersubject  variability.  Here,  the 
rare-stimulus  ERPs  recorded  at  C2  in  two  ex- 
perimental conditions  are  superimposed  upon 
the  ERPs  elicited  by  physically  identical  stim- 
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Fig.  2.  Superimposed  ERP  waveforms  for  rare  and 
frequent  stimuli  in  the  attend  and  ignore  conditions 
for  four  subjects. 
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uli  in  the  same  condition  when  these  stimuli 
were  frequent.  While  the  peaks  enumerated 
above  are  generally  identifiable,  the  relative 
contributions  of  each  peak  to  the  overall 
waveform  varied  considerably  across  subjects. 

It  is  important  to  emphasize  that  the  data 
acquired  in  the  present  experiments  replicated 
in  all  important  aspects  the  data  described  by 
N.  Squires  et  al.  (1975).  The  range  of  inter- 
subject waveform  variability  observed  in  both 
laboratories  is  similar,  as  comparisons  of  the 
ERP  waveforms  in  Fig.  1 and  2 of  both  re- 
ports would  reveal.  Whil  the  mid-latency 
negative  peak  (N210)  and  the  bifurcated  na- 
ture of  the  positive  peak,  with  an  inflection  or 
an  additional  peak  appearing  at  the  arrows  are 
easily  observed,  it  is  not  clear  how  the  relative 
amplitude  of  eaci;  of  the  peaks  should  be  as- 
sayed. 

Within  any  of  the  waveforms  associated 
with  rare  stimuli,  several  components  are  ap- 
parently active  within  the  first  600  msec  fol- 
lowing the  stimuli  (those  represented  by 
N100,  P160,  N210  and  P270  peaks),  and 
when  the  stimuli  are  task-relevant  two  more 
components  (P350  and  SW)  may  also  be  pres- 
ent. Depending  upon  the  temporal  character- 
istics of  the  components,  any  variations  in  the 
form  of  one  component  due  to  experimental 
manipulation  may  result  in  the  apparent  varia- 
tions in  one  or  more  components  that  overlap 
it  in  time.  This,  in  fact,  is  Njp'tanen’s  claim. 
He  contends  that  the  enhanced  P300  is  a man- 
ifestation of  slow,  long-term  positivity.  In  the 
context  of  these  data  his  position  seem?  to 
imply  an  identity  of  the  slow  wave  and  P300. 

Principal  Components  analysis 

Introductory  re. narks 

In  order  to  disentangle  the  effects  of  multi- 
ple components  so  that  the  extent  to  which 
components  are  distinct  in  their  response  to 
the  experimental  variables,  the  ERP  data  were 
subjected  to  a Principal  Components  analysis 
followed  by  an  analysis  of  variance  (Donchin 
1966,  1969;  Donchin  et  al.  1975).  It  is  per- 
haps necessary  to  dwell  here  on  thp  essential 
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similarity  between  Principal  Components 
analysis  and  the  hase-to-peak  procedure  which 
is  more  often  used  in  analvrmg  ERP  data. 

Both  procedures  transform  rojh  ERP,  which 
generally  consists  of  50 — 500  successive  mea- 
sures of  voltage,  into  a set  of  5—6  measures. 

Thv?i  measures  arc  always  “linear  cumbina* 
tions"  of  the  ERP  data.  A linear  combination 
of  a set  of  voltage  values  X;  (with  i ranging 
from  1 to  N,  N being  the  number  of  digitized 
values  in  the  ERP)  is  obtained  by  multiply- 
ing each  X;  by  a coefficient  a,  and  summing 
over  all  the  i’s.  Clearly,  for  any  set  of  Xj  any 
number  of  linear  combinations  can  be  formed 
by  selecting  many  different  sets  of  coeffi- 
cients (a,).  Measuring  the  base-to-peak  ampli- 
tude at  point  k of  a component  of  the  ERP  is  ^ 

equivalent  to  setting  the  value  of  a;  for  some  i 

= k to  1.0  and  zeroing  all  the  other  a;  values. 

The  linear  combination  thus  formed  is  then 
taken  to  represent  an  ERP  component.  The 
selection  of  the  i at  which  a;  = 1.0  is  made  by 
identifying  a latency  range  within  which  the 
investigator  believes  a component  to  exist 
and  identifying  the  value  of  i within  that 
range  for  which  Xj  is  maximal.  The  latency 
ranges  are  chosen  because  the  ERP  waveform 
changes  within  them  in  a consistent  manner 
over  the  entire  set  of  ERPs. 

Principal  Components  analysis  dpfines  com- 
ponents similarly.  It  identifies  the  latency 
• anges  over  which  distinct,  orthogonal,  sources 
of  experimental  variance  can  be  identified. 

For  each  such  source  of  variance  it  provides  a 
set  of  aj’s  such  that  the  linear  combinations 
formed  will  be  orthogonal.  These  linear  com- 
binations, known  as  factor  scores,  are  logical- 
ly equivalent  to  the  base-to-peak  measures. 

They  have,  however,  several  advantages:  (a) 

Being  orthogonal,  the  factor  scores  for  each 
component  can  be  subjected  to  univariate 
analysis  of  variance  (ANOVA).  The  common- 
ly encountered  computations  ot  separate 
ANOVAs  for  each  peak  measure  are  of  doubt- 
ful validity  due  to  the  possible  correlation  be- 
tween measures  in  different  parts  of  the  wave- 
form. (b)  The  process  of  identifying  the  com- 
ponents and  computing  tB»  B comb’n*- 
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tions  is  objective  and  is  rigorously  defined. 

— Any  two  investigators, /fying  the  same  data 
base,  will  obtain  the  same  set  of  factor  scores. 
The  results  will  depend,  of  course,  on  the  ex- 
perimental design.  Analytical  techniques  can 
only  reveal  the  effects  of  the  experimental 
variables  on  the  data.  In  this  way  the  experi- 
menter always  plays  a role,  but  this  feature  is 
inherent  in  all  data  analysis  techniques,  (c) 
The  entire  data  set  contributes  to  the  factor 
scores,  rather  than  the  values  at  a few  selected 
time  points.  This  increases  the  sensitivity  of 
the  experimental  procedures  as  it  reduces  the 
effect  of  noise  and  sampling  fluctuations  on 
the  measurements,  (d)  In  the  app-.opriately 
equipped  laboratory  the  conduct  of  a Princi- 
pal Components  analysis  facilitates  the  analy- 
sis of  many  hundreds  of  ERPs,  collected  in 
experiments  of  considerable  complexity.  All 
that  is  required  is  that  the  ERPs  be  available 
in  computer-compatible  form. 

The  use  of  Principal  Components  is  not  a 
universal  panacea  for  ERP  research.  No  tech- 
nique is.  We  find  it  veq>  useful  whenever  the  1 
experimental  manipulations  are  likely  to  af- 
fect the  relative  amplitudes  of  overlapping 
ERP  components  with  minimal  effects  on 
latency.  The  technique  is,  however,  quite 
weak  when  experimental  manipulations  affect 
the  latencies  of  ERP  peaks.  It  may  also  be  in 
adequate  if  there  are  strong  non-linear  inter 
actions  amongst  the  underlying  components. 
As  it  is  usually  applied,  the  technique  is  also 
blind  to  any  feature  of  the  ERP  waveform 
that  is  not  influenced  by  the  experimental 
manipulations..  In  previous  studies  we  extract- 
ed the  Principal  Components  from  the  corre- 
lation matrix  of  the  data.  This  procedure  sub- 
tracts the  mean  and  scales  the  data  at  each 
time  point  by  its  variance.  Since  the  Principal 
Components  are  components  of  the  experi- 
mental variance  no  components  will  be  ex- 
tracted corresponding  to  peaks  which  remain 
unchanged  across  all  experimental  conditions 
(such  as  P160  in  these  data).  An  alternative 
method,  which  was  used  here,  is  to  analyze 
the  cross-product  matrix  of  the  data.  This 
method  retains  information  about  relative 


variations  in  amplitude,  which  are  of  prime 
interest  here,  and  relates  all  variability  to  a 
pre-stimulus  baseline.  As  such,  the  'esulting 
Principal  Components  are  conceptually  simi- 
lar to  ERP  components  which  are  positive 
and  negative  voltage  variations  rather  than 
variations  about  some  mean  waveform  which 
may  depend  strongly  upon  the  mix  of  ex- 
perimental conditions. 

Results 

The  data  obtained  in  the  two  experiments 
were  analyzed  separately.  The  data  base  for 
each  analysis  was  a set  of  648  ERP  waveforms 
(2  stimuli  X 2 stimulus  probabilities  X 2 task 
conditions  X 9 electrode  sites  X 9 subjects), 
each  with  64  time  points  (12  msec/point). 
The  waveforms  for  the  third,  “count  sou”, 
condition  of  Experiment  II  were  omitted 
from  the  primary  analysis  reported  here  to 
balance  completely  the  design  (equal  numbers 
of  ERPs  from  the  count  and  ignore  condi- 
tions). 

Table  I presents  the  percent  of  the  total 
variance  accounted  for  by  each  of  the  first  20 
factors  extracted  from  the  data  from  each  ex- 
periment. In  both  cases,  most  of  the  variance 
was  accounted  for  by  the  first  6 factors  (93% 
for  Experiment  I and  91%  for  Experiment  II). 
Much  evidence  is  available  showing  that  an 
ERP  dala  matrix  can  be  adequately  represent- 
ed by  6 variables  (see  Donchin  1966,  1969; 
Donchin  et  al.  1970;  Donchin  and  iu.-ning 
1975).  Only  the  first  6 factors  wme  therefore 
used  in  al)  further  analyses.  These  6 factors 
were  then  subjected  to  a Varimax  rotation 
A Varimax  rotation,  while  arbitrary,  is  in 
tuitively  appealing;  it  retains  an  orthogonal 
factor  space  while  maximizing  the  association 
between  each  factor  and  a few  time  points, 
minimizing  the  correlation  at  all  other  points 
for  each  factor.  (In  fact,  an  evoked  potential 
data  matrix  fulfills  many  of  the  preconditions 
enumerated  by  Harshman  (1970)  for  the  use 
of  the  Varimax  procedure.)  The  correlation 
between  each  component  and  a time  point  is 
called  a factor  “loading”  and  in  our  procedure 
it  was  the  factor  loadings  which  were  Varimax- 
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TABLE  I 


Percent  variance  accounted  for  by  each  of  the  first  20 
factors. 


Factor  Experiment  I 

Experiment  I! 

Percent 

Cumulative 

Percent 

Cumulative 

variance 

percent 

variance 

percent 

i 

54.6 

54.6 

47.4 

47.4 

2 

13.1 

67.7 

19.7 

67.1 

3 

12.4 

80.1 

12.3 

79  4 

4 

6.0 

86.1 

5.6 

85.0 

5 

4.2 

90.3 

3.6 

88.6 

6 

2.6 

92.9 

2.5 

91.1 

7 

1.3 

94.2 

2.3 

93.4 

8 

0.9 

95.1 

0.9 

94.3 

9 

0.8 

95.9 

0.8 

95.1 

10 

0.5 

96.4 

0.7 

95.8 

11 

0.5 

96.9 

0.6 

96.4 

12 

0.5 

97.4 

0.5 

96.9 

13 

0.3 

97.7 

0.5 

97.4 

14 

0.2 

97.9 

0.3 

97.7 

15 

0.2 

98.1 

0.3 

98.0 

16 

0.2 

98.3 

0.2 

98.2 

17 

0.2 

98.5 

0.2 

98.4 

If 

0.2 

98.7 

0.2 

98.6 

IS 

0.1 

98.8 

0.1 

98.7 

20 

0.1 

98.9 

0.1 

98.8 

Fig.  3.  Factor  loadings  for  the  6 factors  extracted  by 
the  Principal  Components  analyses  of  Experiment  I 
(solid  lines)  and  Experiment  II  (dashed  lines).  As  in 
Fig.  1,  the  time  scale  is  768  msec. 


rotated.  The  factor  loadings  after  the  Varimax 
rotation  are  plotted  in  Fig.  3 for  Experiment  I 
against  the  correspond inr'  time  points  (solid 
lines).  The  factor  loadings  serve  to  indicate 
the  degree  of  association  between  a factor  and 
each  of  the  64  time  points.  For  instance,  Fac- 
tor 1 is  most  highly  correlated  with  time 
points  in  the  latter  portion  of  the  epoch.  It  is 
over  that  same  portion  of  the  ERP  that  the 
SW  can  be  identified;  consequently  we  identi- 
fy Factor  1 with  the  SW.  Similarly,  Factor  2 
has  a peak  loading  at  about  the  latency  of 
P350.  Factor  3 is  heavily  loaded  at  the  laten- 
cy of  N100  and  has  a reciprocal  loading  at 
the  latency  of  P350.  Factor  4 peaks  at  200 
msec,  suggesting  an  equivalence  to  the  N210 
peak  of  the  ERP.  Factor  5 has  no  prominent 
peaks.  Factor  6 loads  most  heavily  at  250 
msec.  For  more  detail  concerning  the  Princi- 


pal Components  and  factor  loadings,  see  Don- 
chin  etal.  (1975). 

Also  shown  in  Fig.  3 (dashed  lines)  are  the 
Varimax -rotated  loading  functions  from  Ex- 
periment II.  Note  that  each  loading  function 
from  Experiment  II,  except  for  Factor  5,  has 
a time  course  similar  to  that  of  the  analogous 
factor  from  Experiment  I.  It  is  of  some  inter- 
est that  the  ordering  of  factors  according  to 
the  percent  variance  accounted  for  was  the 
same  for  both  experiments.  While  separation 
of  components  of  the  ERP  waveform  through 
the  use  of  Principal  Components  has  been  de- 
monstrated previously  (Donchin  et  al.  1975; 
Kutas  and  Donchin,  iTJTress),  these  data  are 
remarkable  in  demonsi  rating  a virtually  iden- 
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tical  factor  structure  in  two  different  sam- 
ples * 

The  factor  loadings  serve  merely  to  indicate 
the  segments  of  the  epoch  over  which  the  6 
factors  are  maximally  active.  These  data  sug- 
gest an  identification  between,  at  least  some, 
factors  and  classical  ERP  components,  but 
such  interpretations  are  greatly  bolstered 
through  a study  of  the  behavior  of  the  factors 
as  a function  of  the  experimental  variables. 
The  factor  scores  were  therefore  evaluated  for 
each  of  the  648  waveforms  for  each  of  the 
factors.  In  Fig.  4 the  mean  factor  scores  for 
all  factors  except  Factor  5 are  presented  for 
the  three  midline  electrodes  for  all  experi- 
mental conditions.  Since  the  results  of  the 
two  experiments  were  essentially  identical 
the  scores  for  all  subjects  in  both  experiments 
were  averaged  in  Fig.  4.  These  data  summarize 
the  trends  of  the  relationships  between  the 
factor  scores,  amr/iitudes,  and  the  experimen- 
tal variables.  The  reliability  o'  these  trends 
was  evaluated  by  performing  independent 
ANOVAs  of  the  factor  scores  of  each  of  the 
factors.  The  results  of  these  ANOVAs  are 
shown  in  Table  II. 

An  examination  of  the  ANOVA  results  re- 
veals that  the  SVV  factor  (Factor  1)  was  signifi- 
cantly affected  by  the  signal  intensity,  by  task 
requirement  (count  vs.  ignore)  and  by  the 
electrode  site.  No  main  effect  of  signal  proba- 
bility was  apparent,  due  to  the  strong  interac- 
tion between  electrode  site  and  signal  proba- 
bility. The  P350  factor  (Factor  2)  was  modu- 
lated by  the  same  variables  as  the  SW  factor. 
In  addition,  the  effect  of  signal  probability 
on  this  factor  was  statistically  significant.  The 
N100  factor  (Factor  3)  was  influenced  by  sig- 
nal intensity  in  Experiment  I but  not  in  Ex- 
periment II.  It  varied  with  electrode  site  but 

* It  should  be  noted  that  similar  component  struc- 
tures have  been  obtained  in  our  laboratory  in  other 
experiments  in  which  the  experimental  procedures 
were  markedly  different  than  the  ones  used  here. 
For  example,  both  McCarthy  and  Donchin  ( HrT-fr)  • 
and  Duncan-Johnson  and  Donchin  (in  preparation) 
observed  factors  which  are  clearly  analogous  to  Fac- 
tors 1 and  2 we  report  here. 
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was  unrelated  to  signal  probability  or  to  the 
subject’s  task.  The  NiilO  factor  (Factor  4) 
was  affected  by  signal  probability  and  elec- 
trode site  but  unlike  the  P350  and  SW  it  was 
independent  of  task  requirement. 

These  general  statements  about  the  effects 
of  experimental  variables  on  the  various  com- 
ponents are  given  substrance  by  the  plots  of 
the  factor  scores  in  Fig.  4. 

The  slow  wave  shows  a dramatic  interac- 
tion between  electrode  site  and  signal  proba- 
bility when  tones  are  task-relevant  (Fig.  4). 
The  factor  scores  are  large  and  of  opposite 
sign  at  Fz  and  P2  for  relevant  stimuli.  The 
",  scores  are  near  zero  for  all  Trequent  stimuli 
and  for  both  rare  and  frequent  tones  when 
/ the  tones  are  ignored. 
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TABLE  II  202C 

Summary  of  analyses  of  variance.  The  top  entry  for  earli  source  anti  factor  is  the  F value  from  Kspcrimenl  1 anti 
the  bottom  entry  is  the  F-vatue  from  Experiment  II. 


Source/Factor 

df 

1 

2 

3 

4 

5 

6 

A(Signal) 

1,8 

6.26  ♦ 

38.82  * 

7.31  * 

4.76  * 

0.01 

0.38 

17  34  * 

37  97  * 

3.13 

12.37  ♦ 

0.21 

4.62 

B(Propbability) 

1,3 

0.43 

72.72  * 

0.01 

8.77  * 

0.01 

9.64  * 

/ 

0.67 

17.27  * 

0.20 

9.12  * 

6.13  * 

0.50 

C(Task) 

1,8 

13.51  * 

7.87  * 

2.79 

0.02 

1.00 

0.13 

6.12  * 

38.24  * 

0.71 

0.09 

0.58 

1.07 

D(  Electrode) 

8,64 

28.66  * 

2.77  * 

20.19  * 

2.42  * 

0.85 

1.12 

10.53  * 

5.12  * 

' ,~>2  * 

5.49  * 

1.06 

1.46 

A X B 

1,8 

2.81 

37.75  * 

3.17 

0.03 

0.17 

0.18 

13.6  » * 

45.54  * 

0.26 

3.46 

4.19 

2.22 

A X C 

1,8 

3.04 

8.72  * 

0.41 

0.82 

1.85 

1.30 

0.18 

1.48 

1.34 

0.02 

0.02 

1.34 

A X D 

1,64 

4.80  * 

3.14  * 

3.72  * 

2.53  * 

2.65  * 

2.36  * 

3.34  * 

9.42  * 

2.38  * 

5.09  * 

0.21 

5.50  * 

B x 1C 

1,8 

0.50 

8.89  * 

0.71 

1.87 

0.96 

7.83  * 

1.23 

12.57  * 

0.34 

3.67 

0.32 

5.42  * 

B x D 

8,64 

2,8.40  * 

3.36  * 

1.67 

1.27 

0.86 

2.07  * 

18.05  * 

4.37  * 

2.09  * 

1.74 

1.93 

1.15 

CX  D 

8,64 

17.32  * 

1.37 

3.48 

2.70  * 

C.lfi 

0.42 

16.79  * 

3.34  * 

3.96  * 

1.42 

1.96 

0.63 

A X B x C 

1,8 

4.12 

5.48  * 

0.01 

0.07 

0 95 

1.38 

2.17 

0.31 

0.07 

1.01 

0.11 

0.46 

A X B x D 

8,64 

1.82 

2.27  * 

1.89 

2.61  * 

3.96  * 

1.98 

3.45  * 

5.62  * 

0.74 

2.79  * 

1.66 

2.23  * 

A x C x D 

8,64 

2.13  * 

5.06  * 

1.20 

0.61 

4.12  * 

2.58  * 

2.48  * 

2.06 

0.57 

0.89 

0.98 

1.45 

B x C x D 

8.64 

30.77  * 

1.36 

1.93 

0.97 

0.11 

0.49 

20.55  ♦ 

2,25  * 

2.23  * 

0.40 

1.72 

0.75 

A x B x C x D 

8,64 

0.71 

2.31  * 

1.14 

1.34 

5.90  * 

1.77 

2.41 

2.32  * 

0.47 

35 

0.45 

1.31 

* Significant  at  P < 0.05. 
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The  P350  factor  scores  (Factor  2)  are  also 
shown  in  Fig.  4.  Like  the  SW,  P350  was  main 
ly  associated  with  rare,  relevant  stimuli.  Fre- 
quent, relevant  stimuli  were  associated  with 
small  P350  factor  scores,  and  for  irrelevant 
stimuli  the  P350  factor  scores  were  small  re- 
gardless of  stimulus  probability.  Unlike  for 
the  SW,  however,  the  size  of  P350  was  not 
symmetric  for  loud  and  soft  tones  in  the 
counting  condition;  whereas  the  P350  scores 
were  large  for  loud  tones  which  were  rare  and 
relevant,  they  were  small  for  soft  tones  even 
when  they  were  rare  and  relevant.  Whether 
this  was  due  to  the  relative  intensities  of  the 
rare  and  frequent  stimuli  in  each  case  or  to 
the  designation  of  the  loud  stimulus  as  the 
target  event  could  not  be  evaluated  within 
this  analysis  since  the  intensity  and  target 
variables  were  confounded.  Consequently  an 
additional  factor  analysis  was  performed  on 
the  data  from  Experiment  II,  this  time  in- 
cluding the  “count  soft”  condition.  The  fac- 
tors which  emerged  from  the  three-condition 
analysis  were  clearly  analogous  to  those 
shown  in  Fig.  3,  particularly  in  the  cases  of 
the  first  4 factors.  Among  those  conditions 
• which  were  common  to  both  analyses  (all 
except  “count  soft”)  the  variations  in  the  fac- 
tor scores  as  functions  of  signal  probability 
and  electrode  site  were  essentially  the  same 
as  shown  in  Fig.  4.  The  pertinent  result,  how- 
ever, was  that  instructions  to  count  the  soft 
stimuli  were  not  sufficient  to  enhance  the 
rare— soft  stimulus  P350  to  the  degree  shown 
for  the  rare— loud  stimulus.  The  rare— loud 
P350  was  also  much  reduced  when  the  soft 
stimulus  was  the  target  (to  the  size  of  those 
for  the  rare— soft  stimuli).  Thus  the  P350  is 
of  approximately  equal  amplitude  for  rare- 
loud  and  rare— soft  stimuli  in  the  counting 
conditions  unless  the  rare— loud  is  the  target 
event,  in  which  case  the  P350  is  much  en- 
hanced. 

The  presence  of  the  SW  made  it  impossible 
in  the  earlier  study  by  N.  Squires  et  al.  (1975) 
to  determine  with  certainty  the  scalp  distribu- 
tion of  the  P35u.  When  the  effect  of  the  bW  is 
removed  by  the  principal  components  analysis 


it  is  evident  that  P350  for  rare,  relevant  stimu 
li  is  largest  at  C.;,  next  largest  at  I0*,  and  small- 
est at  Fz.  The  distributions  were  identical  in 
both  experiments. 

These  results  bear  directly  on  Naatanen’s 
three-corrponent  hypothesis.  We  clearly  ob 
serve  a long  duration,  “slow”,  process  with  a 
positive  polarity  at  the  parietal  electrode.  Ac- 
cording to  the  time  course  of  the  factor  load- 
ing function  this  process  apparently  begins  to 
affect  the  ERP  waveform  as  early  as  250  msec 
after  the  stimulus.  Thus  it  seems  to  be  an  ex- 
cellent candidate  for  serving  as  Naritanen’s 
slow  positive  process.  Yet,  this  component  is 
clearly  distinct  from  the  P350. 

As  was  expected  on  the  basis  of  previous 
reports  (cf.  Picton  et  al.  1974)  the  N100  fac- 
tor was  larger  at  the  frontal  and  central  sites 
than  at  the  parietal  site.  Also,  it  was  unin- 
fluenced by  variations  in  signal  probability. 

Factor  4 which,  on  the  basis  of  its  peak  la- 
tency, was  associated  with  the  N210  peak  of 
the  ERP  showed  a systematic  decrease  in  its 
factor  score  with  decreasing  signal  probabili- 
ty, which  is  consistent  with  the  emergence  of 
a negative  component  elicited  when  signals 
were  rare.  These  variations  with  signal  proba- 
bility can  further  be  seen  to  be  independent 
of  tasK  requirement.  The  fact  that  the  factor 
scores  were  positive  for  highly  probable  sig- 
nals is  probably  due  to  the  residual  contribu- 
tions of  portions  of  the  Pl6f)  unu  P3D&  ptaks 
which  overlapped  the  skirts  of  the  N210  fac- 
tor loading  function.  The  width  of  the  N210 
loading  functions  is  undoubtedly  wider  than 
the  actual  duration  of  N210  because  of  slight 
latency  differences  between  subjects  and 
across  conditions.  As  shown  by  the  ANOVA, 
however,  variation  in  the  factor  scores  cannot 
be  attributed  solely  to  between-subject  vari- 
ance, 

While  Factor  6 appeared  in  both  experi- 
ments, no  ready  interpretation  of  this  factor 
was  obvious  from  either  the  factor  scores  or 
the  factor  functions.  Possibly  it  is  related  to 
the  P270  peak  of  the  ERP.  Of  all  segments  of 
the  ERP  epoch,  however,  the  region  spanned 
by  Factor  6 is  by  far  the  most  complex  and 
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variable  across  subjects  (Fig.  2).  Consequent- 
ly, it  is  safest  to  note  only  that  there  is  a con- 
__  sistent  source  of  variability  within  this  region. 
Finally'  due^  ta-thc-current  interest  in  later- 
al asymmetries  of  ERP  component  Fried- 
man et  al.  1975,  Donchin  et  al.  in  press),  we 
evaluated  the  extent  to  which  ^Lu^T^asymme- 
^-Hries-appearin  our  data.  No  significant  asym- 
metries were  found  *. 


Discussion 

This  study  has  firmly  established  the  exis- 
tence of  multiple  sources  of  experimental 
variance  within  tne  latency  range  of  the  clas- 
sical P3C0  component  of  the  ERP.  These  fac- 
tors can  be  differentiated  on  the  basis  of  their 
sensitivity  to  experimental  variables  using  a 
Principal  Components  analysis  of  the  wave- 
forms. Stimulus  probability  and  task  require- 
ment, as  well  as  scalp  distribution  appear  to 
be  major  factors  allowing  the  differentiation 
of  iVie  components. 

One  factor  extracted  from  the  data  corre- 
sponds to  the  SVV  component  first  reported 
by  N.  Squires  et  al.  (1975).  A second  was 
found  to  peak  at  about  350  msec  post-stimu- 
lus and  can  be  identified  with  the  component 
variously  labeled  F300  (Smith  et  al.  1970- 
Donchin  et  al.  1973,  1975),  P3  (Wilkinson 
and  Morlock  1967;  Jjilly.ird  et  al.  1971; 
Karlin  and  Martz  1973;  Squires  et  al.  1973; 
Tueting  and  Sutton  1973),  or  P3b  (N.  Squires’ 
et  al.  1975).  The  present  study  has  clarified 
the  scalp  distribution  of  P350  which  in  pre- 
vious work  was  obscured  by  the  presence  of 
the  SVV,  which  affected  basc-to-peak  mea- 
sures. When  the  contribution  of  the  SVV  is  re- 

Space  will  not  allow  a description  of  many  other 
analyses  which  were  performed  on  the  data.  Suffice 
it  to  say  that  a detailed  evaluation  cf  I’n1  rorreJa- 
tion  matrix  yielded  essentially  the  same  results. 
Furthermore,  when  the  results  of  the  Varimax  solu- 
tion are  compared  with  those  obtained  with  other 
rotation  schemes  no  substantial  differences  are  ob- 
served. Readers  interested  in  a description  of  these 
alternate  analyses  can  contact  the  authors. 
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moved,  the  P3o0  factor  appears  to  have  a 
centro-parictal  maximum  (Vaughan  and  Rit- 
ter 1970;  Pieton  and  llillyard  1974;  Donchin 
et  al.  1975).  While  P350  and  SVV  arc  closely 
related  on  the  basis  of  their  modes  of  varia- 
tion under  experimental  manipulation  (hut 
differ  in  scalp  distribution),  they  are  experi 
mentally  separable.  Our  data  show  that  SVV 
is  elicited  by'  all  rare,  relevant  stimuli  while 
P350  is  elicited  mainly  by  rare,  loud  targets. 
Wilson  and  Ashby  (1974)  as  well  as 
Naiitanen  (1975)  have  suggested  that  the 
P300  component  is  a slow,  post-preparatory, 
reactive  positive  vave.  They  attribute  the 
peaked  appearance  of  the  component  with  a 
latency  at  300—400  msec  to  various  experi- 
mental artifacts.  Our  data  show  that  the  slow 
wave  and  P300  are  quite  dislinet  components 
and  therefore  were  not  consistent  with 
Naatanen’s  three-component  hypothesis.  Of 
course,  it  is  possible  that  the  SVV  is  not  equiv- 
alent to  Naiitanen ’s  ‘‘slow-positive  process” 
but  if  such  a process  exists  it  has  failed  to 
materialize  either  in  our  data  or  elsewhere  in 
the  literature.  The  present  results  then  lend 
further  credence  to  the  view  that  P300  is  a ' 
distinct  endogenous  component  of  the  ERP 
which  is  invoked  by  the  task  demands  rather 
than  a reactive  change  in  global  preparedness 
or  a modulation  of  long-lasting  waves. 

Another  probability-related  factor  was 
found  which,  on  the  basis  of  its  latency  (and 
scalp  distribution),  may  be  associated  with 
the  N210  peak  of  the  ERP.  Unlike  the  P350 
and  SVV  which  seem  to  requiie  active  process- 
ing of  stimulus  information  for  their  elicita- 
tion, this  factor  was  associated  with  rare  stim- 
uli regardless  of  the  su  -ct’s  task  require- 
ment. A similar  component  (N2)  was  describ- 
ed by  N.  Squires  et  al.  (1975).  On  the  basis  of 
the  robustness  of  the  N210  factor,  it  must  be 
considered  a major  aspect  of  the  ERP  wave- 
fcffTi -.  Whet.j-r  it  is  ft  la  ltd  to  the  other,  re- 
cently described,  “mid-latency  negative  com- 
ponents” remains  to  be  seen  (Ford  et  al. 
1973;  Pieton  et  al.  1974;  Simson  et  al.  1976; 
Ruchkin  and  Sutton,  in  press), 

Of  the  two  remaining  factors  described  f 
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hero,  one  is  a reflection  of  the  N100  compo- 
nent of  the  auditory  evoked  potential.  An- 
othei  factor  was  found  which,  while  consis- 
tent across  experiments,  was  not  significantly 
related  to  any  of  the  main  experimental  vari- 
ables. The  peak  latency  of  the  loading  func- 
tion for  that  factor  makes  it  a candidate  fcr 
association  with  the  P270  peak  of  the  E^ItJ 
As  described  here  and  by  N.  Squires  el  af! 
(1975,  p.  398),  The  P270  or  P3a  peak  is  the 
waveform  feature  which  is  the  most  variable 
across  subjects.  Occurring  as  it  does  at  a la- 
tency where  there  is  a mix  of  activity  due  to 
three  dominant  components  (N210,  P350 
and  SW),  resolution  of  the  P270  component 
may  be  beyond  the  scope  of  the  Principal 
Components  procedure.  Another  hypothesis 
that  may  be  entertained  is  that  Factor  6 and 
P270  are  not  related  at  all  but  N210  and  P270 
are  aspects  of  the  same  process,  hence  non- 
independent.  This  hypothesis  is  not  contra- 
dicted by  the  present  data  and  is  consistent 
with  the  base-to-peak  analysis  reported  by 
N.  Squires  et  al.  The  only  negative  evidence 
is  from  the  factor  analysis  of  the  peak  ampli- 
tudes reported  by  N.  Squires  et  al.  who  found 
independent  factors  for  N2  and  P3a.  In  that 
analysis,  however,  one  additional  degree  cf 
freedom  entered  into  the  measurements  when 
peak  amplitudes  were  measured  at  slightly 
narying  lab  nrfcts  su-russ  wivefom  i.  tense 
quently,  a dissociation  may  have  been  entered 
into  the  behavior  of  N2  and  P3a.  The  present 
data  can  therefore  be  interpreted  either  as  de- 
pendence between  N200  and  the  P270  (P3a) 
or  as  identifying  Factor  6 with  P3a,  in  which 
case  its  failure  to  be  affected  by  the  experi- 
mental variables  is  puzzling.  Be  that  as  it  may, 
we  do  find  that  one  component  of  the  ERP, 
namely  N210,  reflects  stimulus  probability 
independent  of  task  while  another,  P350,  de- 
pends on  an  interaction  between  stimulus 
probability  and  the  task. 

The  procedures  reported  here  highlight  the 
utility  of  the  Principal  Components— ANOVA 
procedure  (Donchin  Here  -<  impnnpnk 

of  the  ERP  are  interpreted  with  reference  to 
the  experimental  variance.  New  components 


are  identified  only  if  the  voltages  over  a par- 
ticular segment  of  the  epoch  show  systematic 
joint  variations  as  a function  of  the  experi- 
mental variables.  Such  an  analysis  depends  on 
an  identification  of  sources  of  variance  in  the 
data  and  a determination  of  the  extent  to 
which  each  source  is  related  to  each  of  the  ex- 
perimental variables.  It  is  important  to  em- 
phasize that  the  Principal  Components  of  the 
data  matrix  are  not  to  be  interpreted  as  rep- 
resenting specific  neurophysiological  genera- 
tors or  electrocortica!  activity.  They  merely 
serve  to  summarize  the  effects  of  experimen- 
tal variables  on  the  ERP  waveform.  But,  then, 
there  is  no  necessary  relationship  between  any 
scalp  measures  and  underlying  generators.  In 
this  report,  as  well  as  in  others  (Donchin  et  al. 
1975;  N.  Squires  et  al.  1975;  Kutas  and  Don- 
chin, in  press),  it  has  been  shown  that  this 
staged  'analysis  procedure  provides  a powerful 
method  for  objectively  resolving  the  compo- 
nents of  cortical  ERPs. 
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Summary 

Eijjhtren  subjects  were  presented  with 
series  of  tones.  Any  one  tone  was  either  loud 
or  soft,  and  in  any  one  series  the  probability 
of  one  tone  intensity  was  either  0.9  or  0.1. 
Subjects  wrh,  h.strurt.J  iu  Count  the  fre- 
quent tones  or  to  count  the  rare  tones.  The 
stimuli  were  also  presented  while  the  subjects 
were  solving  a word-puzzle.  Event-related 
potentials  (ERPs'  were  recorded  from  9 scalp 
locations  (F,,  C„  Pj,  Fz,  Cz,  Pz,  F4,  C4,  P4) 
referred  to  linked  mastoids.  ERP  components 
were  measured  with  a Principal  Components 
analysis  and  the  relations  between  these  mea- 
sures and  the  independent  variables  were 
evaluated  with  the  ANOVA  procedure. 

This  paradigm  allowed  an  evaluation  of  the 
effect  of  stimulus  probability,  stimulus  rele- 
vance, and  task  relevance  on  the  waveform  of 
the  ERPs.  We  conclude  that  the  P350  compo- 
nent is  (TcJmrtr’iHd  wbentW:'*  ih*  stimu- 

lus is  both  rare  and  in  some  sense  relevant  to 
the  subject’s  tusk  and  the  degree  of  enhance- 
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ment  is  greatest  when  the  rare— relevant  tone 
is  loud.  A “slow  wave”  component  which 
follows  P350  is  related  to  the  same  variables 
but  has  a scalp  distribution  quite  different 
from  that  of  P350.  The  slow  wave  shows  a 
progressive  shift  in  polarity  from  negative  to 
positive  from  the  frontal  to  the  parietal  sites, 
while  the  P350  is  of  nearly  equal  amplitude 
(and  positive)  at  the  centra]  and  parietal  sites 
and  has  a smaller  (positive)  amplitude  at  Fz. 

A third  prominent  component,  negative  in 
polarity,  peaking  at  about  210  msec,  is  most 
pronounced  following  rare  stimuli,  whether 
or  not  they  were  task  relevant.  The  ampli- 
tude of  N210  tended  to  be  largest  at  the 
frontal  electrode. 

This  study  then  demonstrates  that  when 
suitable  measurement  techniques  are  used, 
multiple  endogenous  ERP  components  can  be 
observed,  each  related  to  distinct  aspects  of 
cognitive  behavior. 


Resume 

Influence  de  I'adequation  de  la  tache  et  de  la 
probability  du  stimulus  sur  les  composantes 
de  ERP 

s 

IS 

On  presente  une  serie  de  sons  a sujets. 
Chique  son  est  soit  fort,  soit  doux,  et  dans 
chaque  serie  la  probability  d’intensite  d’un 
son  particular  est  soit  09  soit  01.  I!  est  de- 
mande  au  sujet  de  compter  les  sons  les  plus 
frequents  ou  de  compter  les  sons  rares.  Les 
stimulus  sont  egaleme.it  presentes  lorsque  les 
sujets  sont  en  train  de  resoudre  un  puzzle  de 
mots.  Les  potentiels  lies  aux  evenements 
(ERP)  sont  enregistres  sur  9 electrodes  de 
scalp  (F3,  C3,  P3,  Fz,  Cz,  Pz,  F4,  C4,  P4),  reliees 
a une  electrode  bimastoidienne.  Les  compo- 
santes du  ERP  sont  mesurees  au  moyen  d’une 
Analyse  en  Composantes  Principales  et  les 
relations  entre  ces  mesures  et  les  variables  in- 
dependantes  sont  evaluees  au  moyen  de  la 
procedure  ANOVA. 

Ce  paradigme  permet  une  evaluation  de 
l’effet  de  la  probability  du  stimulus,  de  l’ade- 
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quation  du  stimulus,  et  la  pertinence  de  la 
tache  sur  la  morphologie  des  ERl’s.  Les  au- 
teurs concluent  que  In  composante  P350  est 
augmentee  chaque  fois  que  le  stimulus  qui  la 
declenche  est  a la  fois  ra/e  et  d’une  certaine 
maniere  pertinent,  et  le  degre  d’accroisse- 
ment  est  d’autant  plus  grand  que  le  son  rare 
et  pertinent  est  fort.  Une  composante  “onde 
lente”  consecutive  au  P350  est  liee  aux  me- 
mes  variables  mais  presente  une  distribution 
sur  le  scalp  tout  a fait  differente  de  celle  du 
P350.  Cette  onde  lente  montre  un  change- 
ment  progressif  de  polarite,  de  la  negntivite 
a la  positivite,  entre  les  regions  frontales  et 
parietales  alors  que  le  P300  est  d’amplitude 
a peu  pres  egale  (et  positive)  au  niveau  des 
localisations  centrales  et  parietales  et  a une 
amplitude  moindre  (positive)  au  niveau  de 

Fz. 

Une  troisieme  composante  importante,  de 
polarite  negative,  dont  le  pic  se  situe  a environ 
210  msec,  est  plus  prononcee  apres  des  stimu- 
li rares,  qu’ils  soient  ou  non  pertinents  pour 
la  tache. 

L’amplitude  du  N210  tend  a etre  la  plus 
grande  au  niveau  de  l’electrode  frontale.  Cette 
etude  montre  done  que,  lorsque  des  techni- 
ques de  mesures  adequates  sont  utilises,  de 
multiples  composantes  endogenes  du  ERP 
peuvent  etre  observees,  chacune  d’elles  etant 
liee  a des  aspects  distincts  du  comportement 
cognitif. 

S' 

We  thank  Martha  Kutas  and  Terrence  R.  Dunn  for 
helpful  comments  on  previous  versions  of  fhis  report. 
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EYOND  AVERAGING:  THE  USE  OF  DISCRIMINANT  FUNCTIONS  TO  RECOGNIZE 
VENT  RELATED  POTENTIALS  ELICITED  BY  SINGLE  AUDITORY  STIMULI  * 
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An  estimate  of  the  waveform  of  cortical 
event  related  potentials  (ERPs)  can  oe  obtained 
when  an  ensemble  of  EEG  epochs,  each  an- 
chored to  the  instant  at  which  the  event  oc- 
curred, is  averaged.  Such  ensemble  averages 
have  been  studied  extensively  in  the  past  de- 
cade and  have  provided  valuable  information 
(Regan  1972;  Price  and  Smith  1974).  However, 
the  interpretation  of  the  waveform  of  an 
averaged  ERP  rests  on  the  assumption  that  all 
realizations  of  the  event  are  essentially  identi- 
cal. This  assumption  is  not  always  tenable;  to 
each  specific  occurrence  of  an  event  a subject 
may  react  differently.  When  behavioral  con- 
sequences arc  measured  precisely,  considerable 
variability  is  shown  even  ov*»r  repeated  presen- 
tations of  the  “same"  event:  reaction  times 
vary,  different  associations  are  invoked,  and 
expectations  that  an  event  will  occur  vary 
from  trial  to  trial.  Since  experimental  manipu- 
lations which  affect  mean  reaction  times, 
desision  process,  and  expectancies  for  ensem- 
bles of  events  are  known  to  influence  pro- 
foundly the  waveform  of  the  ERP  associated 
with  the  ensembles,  trial-to-trial  variations  in 
these,  same  variables  are  likely  to  manifest 
themselves  in  trial-to-trial  variations  in  the 


* This  research  was  supported  by  the  Advanced 
Research  Projects  Agency  of  the  Department  of 
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contract  is  monitored  by  the  Defense  Supply 
Agency.  A preliminary  version  of  this  paper  was 
presented  before  the  Society  for  Psychophysiological 
Research. 
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ERP.  The  investigations  of  intertrial  variability 
in  the  waveforms  encounter  formidable  prob- 
lems, however,  as  the  potentials  associated 
with  any  single  event  are  small  relative  to  the 
ongoing  EEG  activity. 

Some  investigators  have  tried  to  sort  experi- 
mental trials  by  their  behavioral  consequences 
(Donchin  and  Lindsley  1966;  Hillyard  et  al. 
1971;  Paul  and  Sutton  1972),  hoping  that  the 
resulting  averages  will  yield  better  estimates 
of  the  waveforms  of  the  ERPs  associated  with 
different  classes  of  trials.  This  techr  ique,  how- 
ever, depends  upon  the  initial  selection  of  a 
trial-sorting  procedure,  as  quite  different 
averaged  waveforms  may  be  obtained  when 
different  sorting  procedures  are  used  (Squires 
et  al.  1973).  Clearly  it  would  b^  useful  to 
have  a technique  whereby  trial-to-trial  assess- 
ments of  evoked  potential  waveforms  can  be 
performed  and  sorting  done  an  the  basis  cf 
categorizations  of  individual  trials.  Comple- 
mentary analyses  of  thp  ERPs  sorted  by  wave- 
form variations  and  by  behavioral  response 
variations  should  aid  in  investigating  the  rela- 
tionships between  evoked  potentials  and  levels 
of  stimulus  processing. 

A technique  for  classifying  single-trial 
evoked  potentials  utilizaHtTfTstepwise  disciim- 
inant  analysis  (SWDA)  has  been  proposed  by 
Donchin  (1969)  and  evaluated  in  some  detail 
by  Donchin  and  Heming  (1975).  Briefly  stated, 
the  procedure  takes  sets  of  EEG  epochs  known 
to  be  associated  with  particular  events  (training 
sets)  and  extracts  a classification  rule  such 
that  new  records,  known  to  be  members  of 
one  of  the  parent  populations  (test  set),  can 
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j be  classified.  The  discriminant  function  has 
been  used  as  a measure  of  differences  between 
average  waveforms  (Donchin  et  al. 1973),  but 
its  application  to  tfie^anaiysis^or single-trial 
records  has  been  illustrated  in  the  past  using 
small  data  sets  (Donchin  1969).  It  has  not  yet 
been  evaluated  against  an  extensive  data  b-’se 
obtained  from  a number  cf  subjects  in  a variety 
of  experimental  conditions.  We  report  here 
such  an  evaluation  of  the  efficacy  of  the  SWDA 
procedure  using  an  extensive  data  base  pro- 
vided by  two  recently  completed  studies 
Donchin  et  al/l 97 5^  Squires  et  al.  submitted 
' > for-puWkataoa.(a)),  ' 
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The  data  were  collected  in  the  study  de- 
scried in  detail  by  Squires  et  al.  (submitted 
■ fef-  publicatieuf ■(»)).  The  subjects  counted 
tones  (1000  c/secT”50  msec  duration)  of  a 
particular  intensity  which  were  substituted 
for  members  of  a train  of  regularly  occurring 
tone  bursts  ot  another  intensity.  Subjects  could 
easily  discriminate  between  the  two  intensities. 
Every  1300  msec  a tone  of  one  of  the  two 
possible  intensities  was  presented  to  the  sub- 
ject through  earphone*.  The  data  reported 
here  were  obtained  when  90%  of  the  tones/  o' 
were  of  a low  intensity  (GO  dB  SPL,  against  a 
continuous  background  of  wids-band  noise  at 
55  dB  SPL).  The  subjects  was  either  to  count 
the  loud  tones/ind  verbally  report  their  num- 
ber after  a block  of  200  trials  or  to  ignore  all 
tones  and  solve  a hidden  word  puzzle.  In  each 
conditiory/  either  400  or  600  trials  were  pre- 
served yielding  approximately  40—60  presen- 
tations of  the  rare  loud  stimulus.  Single-trial 
EEG  data  from  sixteen  subjects  in  that  study 
were  available  for  analysis. 

The  discriminant  functions  (DFs)  developed 
on  this  training  set  were  tested  both  on  the 
data  from  which  they  were  derived  and  on 
another  data  set  (the  test  set^)  collected  in  a 
different  experiment,  described  by  Donchin 
et  al.  (1975),  using  different  subjects.  The 
procedures  for  generating  this  test  set  were 


quite  similar  to  those  in  the  training  set  experi- 
ment except  that  the  subjects  counted  tones 
which  differed  in  frequency  (2000  vs.  1000 
c/sec)  rather  than  intensity.  Frequency  changes 
in  such  an  experiment  have  been  shown  to 
elicit  averaged  waveforms  which  are  essentially 
identical  to  those  eticited  by  intensity  shifts 
(Squires  et  al.  1975).  Six  subjects  participated 
in  the  second  experiment.  The  data  from  an 
additional  subject  who  participated  in  the  first 
experiment  but  whose  data  were  not  available 
for  the  initial  analysis  for  technical  reasons 
were  also  added  to  the  set  of  "new”  single-trial 
waveforms. 

On  ea^h  trial  a 768  msec  epoch  of  EEG  was 
digitized  at  the  rate  of  one  sample  every  3 
msec  and  scored  on  magnetic  tape.  The  epoch 
began  100  i..sec  prior  to  stimulus  onset.  While 
the  EEG  was  recorded  from  nine  scalp  loca- 
tions, this  report  will  deal  with  the  data  re- 
corded at  Fz,  Clt  and  Pz  (according  to  the 
10—20  system)  referred  to  linked  mastoids. 
The  EEG  was  amplified  with  Grass  7PJ22 
amplifiers  (time  constant  0.8  sec  and  upper 
half-amplitude  frequency  60  c/sec). 

The  data  were  scanned  and  epochs  contain- 
ing EOG  artifacts  were  deleted  from  all  analy- 
ses. The  data  baw  contained  an  equal  number 
of  epochs  elicited  by  rare— loud  and  frequent- 
soft  stimuli  for  each  of  the  three  electrode 
sites.  This,  of  course,  required  that  the  records 
associated  with  many  of  the  frequent  stimuli 
be  eliminated,  thus  the  epochs  associated  with 
every  ninth  artifact-free  frequent  stimulus 
were  used  *.  For  the  discriminant  analysis  64 
values  were  used  per  epoch,  which  were  ob- 
tained by  averaging  over  four  successive  time 
points. 


* The  deletion  of  this  substantial  number  of  records 
associated  with  frequent  stimuli  was  dictated  by 
economic  considerations.  The  cost  of  processing  all 
of  the  single  trials  would  have  been  prohibitive.  Not* 
that  the  "frequent”  trials  selected  were  distributed 
evenly  during  the  experimental  session.  In  a related 
study  in  this  laboratory  Duncan-Johnson  and  Don- 
chin (in  preparationV)  did  not  find  systematic 
differences  between  ETKPs  based  on  frequent  stimuli 
selected  from  different  segments  of  a run. 
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The  SWDA  proceduros/  has  been  described 
elsewhere  (Donchin  1966^;  Donchin  etal  1970: 
Donchin  and  Heming  1975;  See  Dixon  1975 
for  specific  details).  The  SWDA  analyses  de- 
scribed were  performed  at  the  Campus  Com- 
puting Network  at  UCLA  using  the  BMDP7M 
stepwise  discriminant  analysis  program  (Dixon 
1975).  All  classification  percentages  we  report 
are  based  on  the  "Jacknife”  classification 
procedure  (Dixon  1975).  In  previous  studies 
we  often  utilized  the  BMD07M  version  of 
program.  While  the  P-  and  O-  series  of  BMD 
differ  in  important  ways,  the  programs  use 
essentially  equivalent  computational  proce- 
dures. Direct  comparison  of  the  results  ob- 
tained when  the  two  programs  were  applied 
to  the  same  data  sets  fail  to  reveal  any  diff;*- . 
ences.  Here  the  input  to  the  program  consisted 
of  the  set  of  digitized  single  trials  from  pairs 
of  conditions  (e.g.,  rare— loud  and  frequent- 
soft  from  a particular  electrode  site).  A subse- 
quent analysis  using  data  generated  by  the 
second  set  of  subjects  was  performed  at  the 
University  of  fllinois  on  a PDP  11/40. 

Results 

Classification  performance  of  St^DA 

Nine  separate  discriminant  functions  (DFs) 
were  made  for  each  subject.  The  first  set  of 
three  DFs  (one  for  each  electrode  site)  was 
computed  from  training  sets  containing  wave- 
forms associated  with  rare— loud  stimuli  and 
waveforms  associated  with  frequent— soft 
stimuli.  Both  stimuli  weu  presented  within 
one  sequence  of  trials  in  which  the  subject 
counted  the  number  of  occur  cnees  of  the 
loud  stimulus.  The  DFs  developed  on  the  basis 
of  these  training  sets  will  discriminate  between 
the  ERPs  elicited  by  rare  and  by  frequent 
stimuli,  which  are  known  to  differ  mostly  in 
the  P300  component  of  the  ERP.  The  averaged 
ERPs  for  both  groups  of  the  training  set  for 
one  subject  at  C*  are  shown  in  Fig.  1,  com- 
parison 1. 

A second  set  of  three  DFs  was  constructed 
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Fig.  1.  Average  ERP  waveform  t from  single- 

trial data  sets  for  one  subjei  t.  The  polarity 
convention  is  negative  up. 


from  a training  set  composed  of  waveforms 
associated  with  rare— loud  and  frequent— soft 
stimuli  presented  when  the  subject  was  solving 
the  hidden-word  puzzle  (the  “ignore”  condi- 
tion), thus  both  tones  were  irrelevant.  A DF 
so  developed  should  allow  a discrimination 
between  rare  and  frequent  events  in  the  back- 
ground of  the  subject’s  attention.  A parr  of 
averaged  ERPs  for  that  training  set  is  shown 
in  Fig.  1,  comparison  2.  The  third  set  of  DFs 
was  constructed  from  a training  set  of  epochs 
associated  with  the  rare— loud  stimulus  in  two 
conditions:  when  the  subjects  counted  that 
stimulus  and  in  the  “ignore”  condition  (com- 
parison 3). 

The  variations  in  ERP  waveshapes  shown  in 
Fig.  1 have  been  documented  and  discussed  j 
elsewhere  (Squires  et  al.  1S75;  submitted  for*'**  yfC  _ 
pubheatien  (x)).  For  the  purpose  of  this  study,  *'•  '~^r' 
the  ERP  waveshapes  shown  in  Fig.  1 encom-  V. 
pass  the  range  of  waveform  variation  common- 
ly encountered  in  the  study  of  the  ERP  and 
. r"'ide  an  apt  test  of  the  efficiacy  of  the 
SWDA  procedure  in  classifying  single-trial 
waveforms. 
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In  the  initial  analysis  we  performed  three 
separate  discriminations  for  each  subject  for 
each  of  the  three  electrode  sites.  The  results 
of  these  analyses  are  presented  in  Table  I.  It 
should  be  emphasized  that  the  program 
discriminates  between  two  groups  of  epochs 
defined  according  to  stimuli  presented  to  the 
subject*,  not  according  to  the  subjects’  re- 
sponses. As  will  be  shown  below  this  sense  of 
“correct”  classification  may  obscure  the  full 
power  of  the  DF  technique. 

When  subjects  counted  the  loud  stimuli 
(comparison  1)  tue  SWpA  uiialysis  classified 
correctly  an  average  of  84%  of  the  waveforms 
across  all  electrodes  (range  68—96).  The  best 
average  classification  performance  was  found 
at  the  C,  electrode  (86%  correct);  however, 
this  varied  from  subject  to  subject  and  the  dif- 
ferences between  electrodes  were  not  statisti- 
cally significant  (F(2,30)  = 2.36,  P>  0.05). 
In  the  analogous  condition  in  which  the  audi- 
tory signals  were  task  irrelevant,  the  mean 
percent  correct  over  all  electrodes  was  74 
(range  64— 95);  again  there  were  no  significant 
differences  between  electrodes  (F(2,30)  = 
0.80,  P>  0.05).  For  the  comparison  of  rare- 
loud  stimuli  when  they  were  counted  versus 
when  they  were  irrelevant  the  classification 
yielded  a mean  level  of  77  (range  62—93)  per- 
cent correct,  with  no  significant  differences 
across  electrodes  (F(2,30)  = 2.27,  P>  0.05). 

Multiple  electrode  procedures 

It  is  evident  from  Table  I that  the  classifica- 
tion can  be  affected  by  the  choice  of  electrode 
site  for  each  subject;  for  instance,  for  the 
comparison  1 there  was  a mean  classification 
performance  difference  of  7 percentages  points 
between  the  best  and  worst  electrode  for  each 
subject,  ranging  up  to  13%.  However,  since 
the  average  classification  performance  was 
approximately  equal  across  electrodes  there  is 
no  a priori  reason  for  selecting  one  site  over 
the  others.  It  seemed  useful  to  devise  a pro- 
cedure which rc-uld  hr  B[  plied  uniformly  with 
out  a pretest  procedure  to  determine  a favour- 
able recording  site  for  each  subject.  The 


approach  taken  was  to  utilize  the  information 
from  multiple  electrode  sites. 

Two  different  multiple-electrode  decision 
rules  were  tested.  One  was  a voting  rule:  if 
the  UFs  for  two  electrodes  yielded  decision., 
which  differed  from  the  third,  the  majority 
ruled.  The  results  of  this  re-analysis  are  shown 
hi  TsiaC  1.  there  was  a significant  overall 
improvement  in  the  classification  performance 
for  the  voting  rule  over  the  performance  for 
individual  electrode  sites  (P  < 0.01  for  all 
comparisons,  two-tail  t test  for  matched  pairs). 
On  the  aveiaBe,lhe  voting  rule  correctly  classi- 
fied 5%  more  trials  than  were  classified  using 
individual  electrodes. 

A second  decision  rule  bases  upon  the  values 
of  the  a posteriori  probabilities  of  group 
membership  was  also  used.  The  a posteriori 
probability  of  each  waveform  is  conveniently 
included  in  the  output  of  the  SVVDA  program 
(see  Donchin  et  al.  1970;  Donchin  and  Hem- 
ing  1975,  for  a discussion  of  these  probabili- 
ties). The  probabilities  of  group  membership 
for  two  groups  are,  of  course,  complementary 
and  the  standard  c!  jcision  rule  is  to  associate 
the  waveform  wittytfhe  group  for  which  the 
a posteriori  probability  is  greater  than  0.5.  A 
potential  advantage  in  using  a combination 
rule  based  upon  the  a posteriori  probabilities 
over  the  previously  described  voting-  rule  is 
that  the  probability  statistics  are  continuous 
between  0.0  and  1.0  and  can  be  considered  a 
measure  of  the  “confidence”  with  which  the 
waveform  is  ascribed  to  one  group  or  another. 
In  this  cas#  the  rule  was  that  an  average  a 
posterior  probability  of  greatei  than  0.5  across 
the  three  electrodes  sufficed  to  classify  a trial. 
The  results  are  also  shown  in  Table  I.  The 
discriminant  performance  for  the  averaging 
rule  was  significantly  better  than  that  for  the 
individual  electrodes  (PC0.01,  t test  for 
matched  pairs)  and  was  essentially  the  same  as 
for  the  voting  rule. 

Information  from  the  multiple  electrodes 
can  also  be  utilized  by  combining  the  wave- 
funin  prior  to  elassriieatkm.  Ushig  data  sets 
made  up  of  potentials  averaged  across  the  three 
electrode  sites,  85%  of  the  waveforms  from 


BEYOND  AVERAGING 


5 


r.  a - 

O 

| SS 

< a jd 


C>  O)  H ~r  P*inCNOCNOr<OC»LO  — yD 

r-cocoo^r*coxir-p-oooococna)ooa>  go 


^ I S 


•-*  lo  •s*  o o HWOM.'^HOnDC'in  -r  ej 
cocoaoor^oocooot-oococooaouoo  cc 


•a 

I oH 


W'toocncocncoTfr^oocofoococj’f  o o 
f-oot^ot'-r-r'hf'oor-oocn^i^co  oo 


P»Tf,cnO-*00*fCOOOCOOOOr-*  CT100 

r-  r-*  p-  a>  p*  oo  p^p-ao  ao  oo  co  oo  p*  o p- 


coor^Tfmmoomc'io-rOTj-r-for-  r-c- 
p*aop-p-c^c^r-oor-aoaoaooop-ao  p- 


o 

tr  . 
n rt  - 

BSi 

< a.o 


ncoopjoaNMo^oco^OTro  o to 
p-cop-p’p-p-oooor-oococ^p-oooao  oo 


■*rHTfnNooMO't»rt0O«iJ»nHo  o o 

hoor-f-f-f-coooi>oot-oop«cncfloo  t- 


C1HgplOnOH<flCO(O^CnO'tO  «*f  00 
oaoop*or-p*oop^p'*p*ocr>r-p'*  p- 


HOoooHoopooooppcoinon  moo 

p-p-oop-p-oop-ooop-p-ocop-p-  p- 


O^H00»rtp-C0»-H(J0T?r-a0'rf^f,C0tD00  rf  p 

p-p-op^p-p-oop-op-op-ooop-  p- 


HL'lOHMrffj'OOCninHPOr^tDCD  %£>  lO 
coooaoj>aocooop-p-cr>cr>aoaoooaocn  oo 


W.  O •*» 

|1s 

■<  O.  XI 


vcnnHppoHp*c*3«)»o<neop-p  Oio 
o>a0ooo>cooooocoooo)0>ooaoao  aoo>  oo 


3 

0 N 

1 ° 


Oopjtopioiooioyjiflo^o^p  oo  to 
cjoocco>ooooaor-oocr>oanooooooa>  oo 


C3C5C0»OOtOW00t,O»fiO,«rP)<0<C  co  oo 

pcnp-o)oooooo<floooocoaooooopo>  oo 


O O O CN  O Tj'Tj'COOinc'JO’fOtDO  O to 

®copcnoooooo^po>cnooooooooo)  ao 


u5<cppio>oinooocnonooNM  poo 
cooopooppoop-poo<^oooopcoo>  00 


c 

« X 

HC'ie*3T},ifi(£)pr3fl^OHOici  too  ^ . 

ifH 


6 


213 


K C.  SQUIRES,  E DONCHIN 


rare-loucl  versus  frequent— soft  stimuli  in  the 
counting  conditions  were  classified  correctly 
(Table  I).  This  was  the  same  as  for  best  single 
electrode  analysis  (as  C*),  but  it  eliminated 
the  occasionally  low  performance  scores  found 
in  the  single-electrode  analyses. 

Distr  button  of  time  points 

While  the  classification  performance  mea- 
sures for  the  SWDA  procedure  were  approxi- 
mately equal  in  each  condition  across  the  three 
electrode  sites,  the  DFs  were  based  upon  dif- 
ferent sets  of  time  points  * at  each  electrode. 
That  is,  the  points  which  optimally  discrimi- 
nated between  the  conditions  were  found  to 
vary  from  one  electrode  position  to  another. 
Since  the  waveforms  themselves  differ  marked- 
ly along  the  midline  from  parietal  to  frontal 
sites  due  to  variations  in  the  size  of  the  con- 
stituent components,  this  finding  was  expected 
and  the  results  support  the  findings  of  previous 
studies  using  this  experimental  procedure 
(Squires  et  al.  1975,  submitted  for  publication 
(x)).  It  is  important,  however,  to  evaluate  the 
'extent  to  which  the  time  points  selected  for 
the  different  subjects  are  randomly  scattered 
across  the  epoch  or  are  concentrated  in  some 
specific  regions  of  the  epoch.  As  Donchin  et 
al.  (1970)  have  noted,  unless  the  time  points 
selected  show  some  systematic  relation  to 
ERP  components,  the  discriminant  function 
cannot  be  taken  to  reflect  substantive  differ- 
ences between  the  ERP  waveforms. 

The  dist^bution  of  time  points  that  were 

found  to  discriminate  best^conditions  in  the 
'three  classifications  can  he  summarized  by 
looking  at  the  first  two  latency  points  selected 
for  each  subject.  The  voltages  of  these  u ncies 
tend  to  be  mcfrtb  powerful  in  discriminating 
between  conditions.  Histograms  were  con- 
structed for  each  comparison  according  to  the 
latencies  of  the  points  measured  from  stimulus 
onset.  In  Fig.  2 the  histogram  bins  roughly 
correspond  to  the  components  of  the  ERP. 


* The  terms  "time  point"  or  “point”  are  used  here  as 
synonyms  for“variable"  in  the  parlance  of  BMDP7M 
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Fig.  2.  Latency  histograms  for  first  two  time 
points  extracted  in  the  discriminant  analyses. 


The  first  bin  extends  from  80  to  150  msec 
and  encompasses  the  N100  component^  Bin 
two  extends  from  150  to  260  msec,  encom- 
passing the  N210  component,  and  bin  three 
(260—400  msec)  encompasses  the  P350  (or 
P300)  component.  Bio  four  (400  msec  and 
greater)  spans  the  range  of  the  slow  wave 
component  (SW). 

In  the  comparison^  in  which  rare— loud 
stimuli  were  counted*  there  is  a peak  in  the 
histogram  for  the  P350  bin  at  all  electrode 
sites;  and  there  is  a trend  for  more  points  to 
be  selected  from  the  SW  bin  as  the  recording 
site  varies  from  Pr  to  F,.  A similar  result  is 
seen  for  the  rare— loud,  counting  versus  ignore 
comparison.  In  the  comparison  where  all 
stimuli  are  irrelevant  the  selection  of  points  is 
more  uniformly  distributed  in  time.  The  ter- 
dency  for  the  SW  poin  s to  be  selected  more 
often  and  the  N100  points  to  be  selected  less 
often  holds,  but  more  points  are  picked  from 
N100  and  fewer  from  the  SW  than  in  the  other 
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TABLE  11 

Latencies  and  weighting  rjcfficienU  for  the  subject-independent  discriminant  functions  The  latencies  arc  re- 
ferred to  stimulus  onset  and  the  weighting  functions  arc  for  voltages  in  arbirary  units  referred  to  a hascline  vnlt- 
ag"  over  the  100  msec  period  pre-stimulus  onset.  The  equation  for  lhc  discriminant  function  is:  DF  = | g 

a|Xi(j),  whete  X^o  is  the  voltage  at  latency  i(j)  (in  msec)  and  n(j)  is  the  weighting  applied  to  that  voltage  value. 


Electrode 

site 

j-  1 

2 

3 

4 

5 

6 

Px 

Latency, 

i(j) 

104 

188 

248 

320 

356 

380 

Weight,  aj 

—0.00209 

-0.00247 

-0.00422 

0 00346 

0.00364 

0.00349 

Cz 

Latency, 

i(j) 

128 

236 

332 

356 

380 

668 

Weight,  aj 

Latency, 

•(i) 

-0.00332 

—0.00258 

0.00395. 

0.00409 

0.00234 

-0  00349 

F* 

224 

344 

380 

476 

536 

572 

Weight,  aj 

-0.00327 

0.00850 

0.00355 

-0.00305 

-0  00301 

-0.00315 

• 

- — 





- 
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conditions.  The  results  of  the  three  compari- 
sons are  consistent  with  the  waveform  differ- 
ences shown  in  Fig.  1 and  the  topographical 
distributions  fo  the  major  components  which  . 
have  been  described  previously  (c.f.,  Squires 
etal.  1975). 

Subject-independent  SWDA 

The  preceding  analyses  were  all  within- 
subject  procedures.  Such  a personalized  treat- 
ment can  be  useful  for  discriminating  single- 
trial ERPs  in  many  situations  of  experimental 
interest;  however,  a generalized  procedure 
which  is  applicable  to  all  subjects  in  this  and 
future  experiments  would  obviously  be  use- 
ful. As  a first  step  toward  such  a procedure, 
DFs  were  computed  for  tach  electrode  site 
for  all  trials  associated  with  rare— loud  and 
frequent— soft  stimuli  when  loud  stir*uli  were 
counted  regardless  cf  subject.  These  are 
shown  in  Table  II.  The  first  time  point  selected 
for  the  group  function  was  one  at  35G  msec 
for  Pt  and  C*  and  one  at  344  msec  for  Ft.  The 
second  points  were  at  218  for  Pz,  668  for  Cz 
and  572  for  F*.  The  results  for  each  e’ectrode 
site  are  shown  in  Table  III.  Clearly  the  group 
function  was  less  successful  at  classifying  trials 
for  each  subject  than  were  the  individual  fun- 


ctions. Remarkable,  the  decrease  in  discrimi- 
nation performance  was  only  about  7%,  from 
34%  for  the  individual  function  mean  to  77% 
for  the  group  mean  across  electrodes. 


TABLE  III 


Percent  correct  for  subject-independent  DF.  Rare- 
loud  vs.  frequent— soft,  count  loud. 


Subjects 

Fx 

c* 

Pz 

1 

72 

71 

66 

2 

73 

80 

80 

3 

74 

80 

71 

4 

82 

85 

95 

5 

69 

76 

78 

6 

81 

80 

79 

7 

69 

79 

85 

8 

73 

76 

75 

9 

65 

75 

69 

10 

76 

76 

83 

11 

74 

81 

75 

12 

70 

72 

79 

13 

76 

77 

77 

14 

77 

74 

73 

15 

82 

77 

76 

16 

80 

78 

78 

Mean 

75 

77 

78 

S.D, 

5 

4 

7 
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Applying  the  group  function  to  new  subjects 

Using  a PDP11/40  computer,  the  digitized 
waveforms  from  comparison  1 for  seven  new 
subjects  were  read  off  tape  and  the  group  dis- 
criminant functions  for  each  electrode  site 
were  applied.  The  discriminant  function 
weightings  of  Table  II  were  multiplied  by  the 
single-trial  waveform  voltages  at  the  appropri- 
ate latencies,  thus  yielding  a statistic  (discrimi- 
nant score)  to  which  a decision  rule  was  ap- 
plied.  SinceT-trial  waveforms  with  discriminant 
scores  greater  than  a criterion  level  determined 
during  the  calculation  of  the  group  discrimi- 
nant function  were  classified  as  having  been 
elicited  by  rare-loud  stimuli  and  those  which 
were  smaller  were  classified  as  elicited  by 
frequent— soft  stimuli.  It  was  possible  to  use 
the  SWD  A -determined  criterion  directly  since 
the  new  data  were  collected  in  a manner  iden- 
tical to  the  original  data  and,  thus,  required 
no  rescaling.  (If  the  DFs  of  Table  II  were  ap- 
plied to  data  collected  with  a different  ampli- 
fication, the  data  would  have  to  be  scaled 
appropriately  or  a new  criterion  level  adopted.) 
The  results,  shown  in  Table  IV,  indicate  that 
the  subject-independent  group  function  is  as 
effective  in  classifying  the  new  data  as  it  was 
in  the  case  of  the  data  from  which  it  was  de- 


TABLE IV 


Percent  correct  for  subject-independent  DF  applied 
to  new  subjects. 


Subjects 

F, 

c* 

P* 

Average 

discrim. 

score 

17 

77 

79 

83 

85 

18 

78 

72 

74 

80 

19 

83 

78 

80 

84 

20 

66 

70 

69 

74 

21 

66 

74 

77 

76 

22 

77 

77 

80 

82 

23 

83 

82 

83 

84 

Mean 

76 

76 

78 

81 

S.D. 

7 

4 

5 

4 
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rived.  For  the  new  group  the  mean  classifica- 
tion performance  was  nearly  identical  to  that 
for  the  original  group,  76%  correct.  Evidently 
the  original  sample  of  sixteen  subjects  (training 
set)  was  large  enough  to  create  a generalizable 
group  function. 

As  was  the  case  for  the  original  set  of  data, 
a decision  rule  based  upon  information  from 
the  three  electrode  sites  was  found  to  improve 
the  precision  of  the  classifications.  By  averag- 
ing the  discriminant  scores  across  electrodes 
prior  to  applying  the  decision  rule  (a  procedure 
analogous  to  the  averaging  rule  used  previous- 
ly), the  mean  classification  performance  across 
subjects  was  raised  to  81%  correct. 


Discussion 

From  the  previous  analyses  it  is  clear  that 
the  SWDA  procedure  for  classifying  single-trial 
auditory  evoked  potentials  can  be  used  with  a 
high  degree  of  reliability  in  contexts  familiar 
to  evoked  potential  research.  When  waveform 
differences  are  quite  pronounced,  as  were 
those  between  the  evoked  potentials  elicited 
by  rare— louo  and  frequent — soft  stimuli 
which  are  task  relevant,  correct  classifications 
were  made  on  89%  of  the  trials  when  subject- 
specific  DFs  in  conjunction  with  a simple  pro- 
cedure for  utilizing  the  wavefoims  from  three 
electrode  sites  were  used. 

In  a more  general  procedure  in  which  dis- 
criminant functions  are  developed  on  the  basis 
of  one  set  of  data  and  applied  to  another,  a 
respec^ible  81%  of  the  trials  were  shown  to  CL 
be  correctly  classified  on  the  basis  of  of  three  A 
electrode  sites.  These  results  undoubtedly  do 
not  reach  the  level  which  might  be  obtained 
with  an  optimum  procedure;  in  fact  they  are 
conservative  since  no  attempt  was  made  to 
optimize  the  decision  criterion  (which  was 
derived  from  the  group  function)  for  each 
subject,  yet  they  indicate  that  the  procedure 
may  be  a feasible  one  for  classifying  single- 
trial evoked  potentials  on-line  in  experimental 
situations.  Once  discriminant  functions  have 
been  computed  on  a representative  set  they 
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can  be  readily  applied  to  subsequently  acquired 
waveforms.  At  the  present  time  the  initial 
computation  of  an  appropriate  DF  requires 
access  to  large  computing  facilities  but  once 
developed,  application  of  the  function  presents 
a computational  load  which  is  well  within  the 
capability  of  mini-computers  commonly  used 
in  evoked  potential  research. 

It  should  be  noted  that  the  algorithm’'  per- 
formance is  evaluated  here  using  a somewhat 
arbitrary  definition  of  the  correctness  cf  class- 
ification. That  is,  the  DF  had  to  identify  the 
value  of  the  signal  that  was  actually  presented 
in  order  to  be  considered  correct.  Thus  the 
assumption  if  made  that  the  subjects  always 
respond  to  s rare  stimulus  as  if  it  is  rare  and 
to  a frequent  stimulus  as  if  it  is  frequent. 
Under  such  an  assumption  the  principal  source 
a'  of  classification  errors  is  the  ^yel  of  EEG  activ- 
ity present  at  the  time  of  signal  occurrence.  It 
is  conceivable,  however,  that  some  rare  stimuli 
evoke  a “frequent”  ERP  and  vice  versa.  In 
such  a case,  the  program  dors  not  “err”  if  it 
classified  a rare  stimulus  as  frequent.  In  fact, 
it  tends  to  reveil  the  fine  structure  of  the  sub- 
ject’s behavior  which  is  obscured  in  group 
averages.  In  order  to  determine  whether  this 
indeed  was  the  case,  F.RP  waveforms  were 
computed  for  each  category  of  stimulus  and 
classification  and  are  illustrated  in  Fig.  3 for 
the  rare— loud  vs.  frequent -soft,  attend  classi- 
fication. Here  the  ERP  is  taken  across  all  sub- 
jects in  order  to  have  sufficient  classification 
“errors”  for  a clear  ERP  waveform.  If  the  mis- 
classified  trials  had  been  due  merely  to  vari- 
ations in  the  ongoing  EEG,  similar  averaged 
waveforms  would  have  been  generated  for 
each  stimulus  regardless  of  the  classification. 
Clearly  that  was  not  the  case.  As  has  been  re- 
ported by  Donchin  (1969),  the  misclassifica- 
tions  seem  to  represent  differences  in  the  ERP 
waveform  from  trial -to-trial.  Rare  stimuli  clas- 
sified as  frequent  fail  to  elicit  a P300  while 
frequent  stimuli  classified  as  rare  elicited  an 
ERP  with  a P300.  While  this  analysis  suggests 
that  the  DF  is  quite  good  at  classifying  single- 
trial waveforms,  the  significance  of  these  vari- 
ations in  terms  of  the  subject’s  behavior  can- 
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Fig.  3.  Average  ERP  waveforms  sorted  accord- 
ing to  stimulus  presentation  and  stimulus  classi- 
fication by  discriminant  function.  Average  across  data 
sixteen  subjects. 


not  be  directly  assessed  here  since  a simulta- 
neous trial-by-trial  behavioral  response  was 
not  recorded.  A clue  to  the  source  of  the  vari- 
ations was  found , however,  through  a selective- 
averaging  analysis  of  portions  of  the  data.  The 
results  strongly  suggest  that  the  discriminant 
score  for  each  ERP  is  closely  related  to  the 
pattern  of  stimuli  preceding  it.  This  topic  is 
treated  in  detail  elsewhere  (Squires  et  al.  ■ 
submitted-for  publication  (b)).  For  the  pres-  i*1 
ert,  these  results  indicate  the  potential  useful- 
ness  of  the  technique  for  evaluating  trial-to- 
trial  variations  in  stimulus  processing  other 
than  through  an  overt  behavioral  response  by 
the  subject. 

Summary 

A test  of  the  stepwise  discriminant  analysis 
(SWDA)  procedure  for  assessing  single-trial 
event  related  potentials  (ERPs)  is  presented. 
Discriminant  functions  (DFs)  were  built  from 
a data  base  composed  of  single-trial  ERPs 
from  sixteen  subjects  who  were  presented 
trains  of  loud  and  soft  tones.  Loud  tones 
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occurred  randomly  on  10%  of  the  trials.  Sub- 
jects either  counted  the  rare— loud  stimuli  or 
solved  a hidden-word  puzzle.  Various  DFs  at 
three  electrode  sites  (F*,  Qt  and  P,)  were  ob- 
tained to  assess  the  feasibility  of  performing 
pairwise  discriminations  between  the  various 
combinations  of  events  which  are  defined  by 
this  procedure.  For  the  pair  of  events  which 
yielded  the  most  striking  differences  between 
their  average  ERP  waveforms  it  was  possible 
to  classify  correctly,  an  average  of  84%  of  the 
events  using  information  from  one  electrode 
site,  and  89%  of  the  events  if  information 
from  multiple  electrode  sites  was  used.  A 
“subject-independent”  DF  was  developed  from 
these  data  and  applied  tj  nata  obtained  from 
seven  new  subjects.  This  subject-independent 
function  proved  to  be  sufficiently  generalized 
to  classify  correctly  81%  of  the  trials.  The 
nature  of  classification  errors  by  this  procedure 
are  discussed. 


Resume 

Au-deld  du  moyennage:  /’ utilisation  des  fonc- 
tions  discriminan  tes  pour  reconnoitre  des 
potentiels  lies  a .in  euenement,  evoques  par 
stimulus  auditif  hole 

Un  procede  de  test  d’analyse  discriminante 
pas-a-pas  (SWDA)  est  presentee,  qui  sert  a 
mesurer  des  potentiels  lies  a un  evenement 
(ERPs)  sous  forme  de  stimulus  unique.  Les 
fonctions  discriminantes  (DFs)  sont  con- 
struites  a partii  d’une  donnee  de  base  composee 
de  ERPs  apres  stimulus  unique  chez  16  sujets 
a qui  ont  ete  presentes  des  trains  de  sons  forts 
et  legers.  Les  sons  forts  surviennent  de  fagon 
aleatoire  10%  des  essais,  la  consigne  donnee 
aux  sujets  est  soit  de  compter  les  stimuli  rares 
et  forts,  soit  de  resoudre  un  puzzle  de  mots 
caches.  Differentes  DFs  ont  ete  obtnues  a trois 
sieges  d’electrodes  (F,,  C,.  et  Pz)  pour  mesurer 
la  possibility  de  realisation  de  discrimination 
par  paires  entrj  les  diverses  combinaisons 
d'evenements  qui  sont  defins  par  cette  pro- 
cedure. Pour  b f flire  d’4v£nem«ita  pour 


laquelle  les  differences  de  morphologie  des 
ERPs  moyens  sont  les  plus  frappantes,  il  est 
possible  de  classer  corrcctement  en  moyenne 
84%  des  evenements  a l’aide  d’informations 
venant  d’un  siege  d ’electrode  et  89%  des 
evenements  si  l’information  provenant  de 
plusieurs  electrodes  est  utilisee.  Une  DF 
"independante  du  sujet”  est  developpee  pour 
ces  donnees  et  appliquee  aux  donnees  obten- 
ues  chez  7 nouveaux  sujets.  Cette  fonction 
“independante  du  sujet”  s’avere  suffisamment 
generalisee  pour  classer  correctement  81%  des 
sequences.  La  nature  des  erreurs  de  classifica- 
tion venant  de  cette  procedure  est  discutee. 

We  thank  Connie  Duncan-Johnsnn  G-eyorp- 
McCarthy  and  Nancy  Squires  for  helpful  comments 
on  previous  versions  of  this  report. 
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